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(54) Moving picture decoding circuit 

(57) When a macro block (MB) synchronizing signal 
(MBSYNC) indicating starting of processing is asserted 
in processing of one processing section which is formed 
by a macro block header and a macro block, block data 
of the macro block (MB) are decoded in synchronization 
with the assertion of MBSYNC, and next macro block 
header Information Is analyzed in continuation in the 



processing section. The assertion of the next MB syn- 
chronizing signal Is stopped until prescribed conditions 
are established. Processing of the block data of the 
macro blocks is regularly executed from starting of one 
processing section, whereby utilization efficiency of 
operational processors is improved. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention s 

[0001] The present invention relates to a picture 
decoding circuit for expanding compressed picture data 
and restoring uncompressed picture data, and more 
particularly, it relates to a moving picture decoding cir- 
cuit for expanding picture data which are compressed in 
accordance with a moving picture compression system 
employing orthogonal transformation and inter- 
frame/inter-field predictive encoding. 

Description of the Background Art 

[0002] There has been proposed a system of 
encoding an enormous quantity of picture data in high 
efficiency to reduce the amount of data for transmission 
and decoding the transmitted picture data encoded in 
high efficiency thereby restoring the original pictures. 
Such picture data processing systems include the 
MPEG (moving picture experts group) standard, which 
is directed to moving pictures. While the system of 
encoding pixel data under the MPEG standard is well 
known in the art, the system of encoding picture data 
along the MPEG standard is now described, in order to 
facilitate understanding of the background of the 
present invention. x 
[0003] Fig. 27 schematically illustrates the structure 
of a general picture data encoding unit along the MPEG 
standard. Referring to Fig. 27, the encoding unit 
includes a subtracter 1000 which obtains difference 
between input pixel data and corresponding pixel data as 
(reference pixel data) of a predicative picture, a OCT 
converter 1002 performing discrete cosine transforma- 
tion (DCT) processing, which is one of orthogonal trans- 
formation processing methods, on a signal (prediction 
error signal) outputted from the subtracter 1000, and a <o 
quantizer 1004 which quantizes a signal (DCT coeffi- 
cient) outputted from the DCT converter 1 002. 
[0004] As described later in detail, pictures include 
various types such as I, P and B pictures, and prediction 
systems are varied depending on the types of the pic- 45 
tures. The I pictures are subjected to intra-frame or 
intra-field encoding, so that input pixel data themselves 
are encoded. The P pictures are subjected to inter- 
frame or inter-field predictive encoding from past repro- 
duced pictures. The B pictures are predicted through so 
either or both of past reproduced pictures and future 
reproduced pictures (frame or field). The B pictures are 
predictive ty encoded (prediction-encoded) using the I 
and P pictures. The B pictures are not employed as ref- 
erence pictures. 55 
[0005] In the case of inter-frame or inter-field pre- 
diction, motion compensation is carried out Blocks in 
prediction pictures having the highest correlation with 



blocks (segments serving as processing units) of the 
current picture are obtained so that predictive encoding 
is carried out using the blocks having the highest corre- 
lation. Displacements between the current and predic- 
tion picture blocks are obtained as motion vectors, 
which are appended to respective pixel data blocks and 
transmitted. In general, the motion compensation is 
executed In units of blocks (segments) of 16 by 16 pix- 
els. 

[0006] The DCT converter 1 002 generally executes 
DCT processing in units of blocks of 8 by 8 pixels. Spa- 
tial redundancy (high correlation between adjacent pix- 
els) in the pictures is reduced by the DCT processing. 
Namely, ft is possible to make DCT coefficients localized 
in a low-frequency coefficient region by carrying out the 
DCT processing In the DCT converter 1002, thereby 
enabling reduction of the picture data quantity through 
processing by quantizer 1 004 at the next stage. 
[0007] In a quantization table 1012, great values 
are set for high-frequency components. The quantizer 
1004 quantizes the DCT coefficients received from the 
DCT converter 1002 with reference to the quantization 
table 1012, whereby low-frequency components can be 
increased In value and high-frequency components can 
be substantially zeroed in both of horizontal and vertical 
directions in the spatial frequencies. Thus, the data 
quantity is reduced 

[0008] The encoding unit further includes a zigzag 
scanner 1006 which sequencizes the quantized data 
received from the quantizer 1004 in prescribed order in 
a zigzag fashion, a variable length encoder 1008 which 
variable-length encodes the data received from the zig- 
zag scanner 1008, and a transmission encoding circuit 
1010 which receives the variable-length encoded data 
from the variable length encoder 1008, motion vector 
information from a motion vector detector (not shown) 
and Information Indicating attributes of other blocks and 
variable-length encodes the motion vector information 
and the attrtoute information in accordance with a pre- 
scribed format for outputting while adding error code 
words etc. thereto. 

[0009] As shown in a block 1015 on the left side of 
Fig. 27, the zigzag scanner 1006 sequencizes 8 by 8 
DCT coefficients in a zigzag manner successively from 
the upper left portion to the lower right portion (I.e. , high- 
frequency component region). Among the DCT coeffi- 
cients shown in the DCT coefficient block 1015 of Rg. 
27, the uppermost left one is called a DC coefficient 
indicating the average value of data of block of 8 by 8 
pixels, while the remaining DCT coefficients are called 
AC coefficients. Nonzero coefficients are efficiently 
caught by zigzag-scanning the DCT coefficients by the 
zigzag scanner 1006. 

[0010] The variable length encoder 1008 succes- 
sively two-dimensional ry variable-length encodes the 
quantized DCT coefficients received from the zigzag 
scanner 1 006 with respect to both the number (runs) of 
precedent zero coefficients (null coefficients) and val- 
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ues (levels) of the nonzero coefficients (significant coef- 
ficients). This variable length encoder 1008 variable- 
length encodes the quantized OCT coefficient data 
received from the zigzag scanner 1006 through a cod- 
ing table 1014 which is developed along Huffman 5 
codes, for example. In the quantized DCT coefficients, 
many zeros are present in high-frequency components, 
and many of significant coefficients are present in low- 
frequency components. Codes of small lengths are 
allotted to the significant coefficients while codes of w 
large code lengths are allotted to quantized coefficients 
having small appearance frequencies, thereby further 
reducing the data quantity. 

[001 1 ] Fig. 28 illustrates exemplary arrangement of 
pictures transmitted from the transmission encoding cir- is 
curt 1010 shown in Fig. 27. 13 pictures having picture 
numbers 1 to 13 are illustrated in Fig. 28. The pictures 
of Nos. 1 and 13 are I pictures, and the pictures of Nos. 
4, 7 and 10 are P pictures. Two B pictures are inserted 
between an I picture and a P picture or between a pair 20 
of P pictures. The I pictures are subjected to only intra- 
frame encoding with no predictive encoding. The P pic- 
tures are subjected to inter-frame or inter-field predic- 
tive encoding (with motion compensation), and the B 
pictures are bidirectionalry prediction-encoded (with 25 
motion compensation), for example. The I pictures (IX 
the P pictures (P) and the B pictures (B) may be field 
pictures, or frame pictures. In prediction of the B pic- 
tures (B), interpolation Is carried out with I and P pic- 
tures or P pictures which are precedent and subsequent so 
thereto in time base, for example. The P pictures are 
subjected to predictive encoding (with motion compen- 
sation) with I pictures (I) or P pictures (P) which are 
precedent thereto in time base. Only the I and P pic- 
tures are employed as predictive pictures, while the B as 
pictures (B) are not employed as predictive pictures. 
[0012] Fig. 29 illustrates the structure of one pic- 
ture. Referring to Fig. 29, a single picture (field or frame) 
1 020 is divided into a plurality of segments called macro 
blocks. For the purpose of simplification, the picture 40 
1 020 Is divided into 32 macro blocks MB#1 to MB#32 in 
Fig. 29, for example. Processing of a moving picture is 
executed in units of the segments called macro blocks 
(in both of encoding and decoding). Each of the macro 
blocks MB#1 to MB#32 generally includes 256 pixels 45 
which are arranged in horizontal 16 pixels by vertical 16 
pixels. Therefore, the picture shown in Rg. 29 Is formed 
by 128 by 64 pixels. 

[0013] Rg. 30 schematically illustrates the structure 
(syntax) of a bit stream (plural bit widths) of picture data, so 
Referring to Rg. 30, the bit stream is divided into a plu- 
rality of layers including a sequence layer, a GOP (group 
of pictures) layer, a picture layer, a slice layer, a macro 
block layer and a block layer. 

[0014] The block layer is formed by a block 1 100 ss 
including a region 1100a including DCT coefficients, 
and a region 1 1 00b storing an End Of Block (EOB) indi- 
cating an end of the block. The region 1100a stores 



DCT coefficient data of pixels of 8 rows and 8 columns 
serving as a unit of DCT processing. If the final AC coef- 
ficient of the region 1 1 00a is a nonzero coefficient in this 
block 1100, the end of block of the region 1100b may 
not be employed. 

[0015] The macro block includes a prescribed 
number of (six) blocks 1 1 00. The macro block on the bit 
stream Includes data blocks formed by the blocks 1100, 
and a macro block header 1115 for variable-length 
encoding and storing data attributes, a motion vector 
etc. of the data blocks. 

[0016] The slice layer includes slices 1 120, each of 
which is formed by one or a plurality of macro blocks 
1 1 00 concatenated in picture scan order. A slice header 
1 125 storing information indicating a vertical position of 
the slice on the screen and Information such as a start 
code having a prescribed pattern indicating starting of 
the slice is provided at the head of the slice 1120. This 
slice layer, which is the lowermost layer among those to 
which codes of prescribed patterns are allotted, is 
employed as the unit of resynchronization in error gen- 
eration. 

[0017] The picture layer includes pictures 1130, 
each of which is formed by a plurality of slices 1120. A 
picture header 1135 storing information indicating the 
type of the picture (I picture, P picture etc.) and Informa- 
tion such as a start code indicating starting of the pic- 
ture in a variable length symbol (variable length code 
word) Is arranged at the head of the picture 1 1 30. 
[0018] The GOP layer includes GOPs 1140 each 
including a plurality of pictures 1130. Each of the pic- 
tures 1 130 included in each GOP 1 140 Includes at least 
one I picture and zero or a plurality of P or B pictures. A 
GOP header 1145 storing information such as a GOP 
start code, a flag indicating that this GOP requires no 
reference from picture data of a precedent GOP etc is 
arranged at the head of the GOP 1 1 40. 
[0019] The sequence layer includes sequences 
1 150, each of which is formed by one or a plurality of 
GOPs 1140 or one or a plurality of pictures 1130. A 
sequence header 1 155 storing information such as the 
screen format is arranged at the head of the sequence 
1150. This sequence header 1155 can be arranged at 
the head of every GOP 1 140 included in the sequence 
1 150 (for allowing reproduction of pictures from an inter- 
mediate stage of the sequence). The sequence header 
1 155 stores information such as a start code having a 
prescribed pattern indicating starting of the sequence, 
horizontal and vertical sizes of the pictures, a picture 
rate (picture display rates), a bit rate and contents 
thereof etc 

[0020] Rg. 31 illustrates the relation between each 
picture and the slices. As shown in Rg. 31 , a single pic- 
ture 1 130 includes a plurality of slices 1120. The slice 
1120, which can have an arbitrary length, returns to the 
left end upon reaching the right end on the screen. 
[0021] Fig. 32 illustrates the data block structure of 
each macro block 1110. The macro block 1 1 00 includes 
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regions 1 100aa to 1100ad storing DCT coefficient data 
Y1 to Y4 for regions obtained by dividing the macro 
block into four portions, and blocks 1100ae and 1 100af 
Including subsampled chrominance signals Cb5 and 
Cb6 respectively. The chrominance blocks 1100ae and 5 
1100af are subsampled in the vertical and horizontal 
directions, whereby the four luminance blocks 1100aa 
to 1100ad and one chrominance block ttOOae (or 
1100af) have the same dimensions on the screen. 
Motion compensation Is executed in units of the macro 
blocks 1110 (MB) each of 16 by 16 pixels, while DOT 
processing Is executed in units of blocks each of 8 by 8 
pixels. 

[0022] Rg. 33 schematically Dlustrates the structure 
of a conventional picture decoding ctrcuft 1200. The pic- 
ture decoding circuit 1200 shown in Fig. 33 expands 
picture data which are encoded by the encoding unit 
shown In Rg. 27 and restores the original picture data. 
[0023] Referring to Rg. 33, the picture decoding cir- 
cuit 1200 includes a FIFO interface 1210 receiving an 
incoming bit stream (plural bit width) and storing/read- 
ing the same in/from an external memory 1230 In a 
FIFO (first-in first-out) fashion, a variable length decoder 
1212 variable-length decoding pixel data which are sup- 
plied through the FIFO interface 1210 in units of seg- 
ments (macro blocks) and generating quantized OCT 
coefficient data (quantized indices) of fixed length data, 
an inverse quantizer 1214 inverse-quantizing the data 
outputted from the variable length decoder 1212 and 
generating DCT coefficient data, a scan converter 1 21 6 
sequencing the data outputted from the inverse quan- 
tizer 1 21 4 for generating DCT coefficient data which are 
arranged in scan order, an inverse discrete cosine con- 
verter 1218 executing Inverse discrete cosine transfor- 
mation, which is one of inverse orthogonal as 
transformation methods, on the data outputted from the 
scan converter 1216, and a pixel recorrfigumtor 1220 
receiving pixel data (differential data) outputted from the 
inverse discrete cosine converter 1218 and predictive 
picture pixel data supplied from the external memory 40 
1230 through a memory Interface 1224 for restoring 
(reconfigu rating) original pixel data. 
[0024] The FIFO interface 1210 accesses the exter- 
nal memory 1 230 through the memory interface 1 224 to 
store/read the Incoming bit stream in the FIFO fashion 45 
thereby buffering the incoming bit stream and eliminat- 
ing difference between the bit rate thereof and the data 
processing rate in the picture decoding circuit 1200. 
[0025] The variable length decoder 1212 detects 
headers of respective layers from the bit stream sup- so 
plied through the FIFO Interface 1210, analyzes the 
detected headers, and executes data processing of 
respective blocks (blocks included in macro blocks) in 
accordance with the results of the analysis. Thus, the 
variable length decoder 1212 executes a header analy- 55 
sis operation and variable length decoding processing 
of quantized DCT coefficients. This variable length 
decoding processing Includes processing of restoring 



quantized DCT coefficients of fixed lengths from varia- 
ble-length encoded run-length data. 
[0026] The inverse quantizer 1214 inverse-quan- 
tizes the quantized DCT coefficients received from the 
variable length decoder through quantized data of a 
quantization table (quantization matrix: not shown) to 
restore or reconstruct the DCT coefficients. This quanti- 
zation matrix may be written in a quantization table 
which is included in the inverse quantizer 1214 through 
the variable length decoder 1212. 
[0027] The scan converter 1216 receives zigzag- 
scanned DCT coefficient data, shown in Rg. 27, which 
are supplied from the inverse quantizer 1214, and re- 
arranges the scan order thereof to the original order. 
The Inverse discrete cosine converter 1218 performs 
inverse discrete cosine transformation processing on 
the DCT coefficient data which are supplied from the 
scan converter 1216, and restores prediction-encoded 
data. The pixel reconfigurator 1220 reads necessary 
prediction picture pixel data from the external memory 
1230 through the memory interface 1224 in accordance 
with motion vector data and macro block attribute data 
from the variable length decoder 1212, adds up the read 
pixel data with the differential pixel data supplied from 
the inverse discrete cosine converter 1218 to reconfig- 
ure original pixel data, and restores the original pixel 
data for storing the same in the external memory 1230 
through the memory interface 1224. 
[0028] The processing in the pixel reconfigurator 
1220 is varied in correspondence to the I, P and B pic- 
tures. In the case of pixel data of pictures such as I pic- 
tures which are subjected to intra-trame encoding, pixel 
data supplied from the inverse discrete cosine converter 
1218 are picture data themselves and no predictive 
encoding Is carried out and hence the pixel reconfigu- 
rator 1220 writes the pixel data which are supplied from 
the inverse discrete cosine converter 121 8 in the exter- 
nal memory 1230 through the memory interface 1224. 
In case of pixel data of P or B pictures which are sub- 
jected to inter-frame or inter-field predictive encoding, 
pixel data which are supplied from the inverse discrete 
cosine converter 1218 to the pixel reconfigurator 1220 
are prediction error signals which are provided by the 
difference with reference to already decoded pixel data 
(predictive picture data). In this case, therefore, the pixel 
reconfigurator 1220 adds up corresponding predictive 
picture pixel data from the external memory 1230 and 
the pixel data from the inverse discrete cosine converter 
1 21 8 with each other, and writes the results of the addi- 
tion in the external memory 1230 through the memory 
interface 1224 again. 

[0029] The picture data written in the external mem- 
ory 1230 are read in the raster scan order through the 
memory interface 1224, and supplied to a display unit 
through a picture display control circuit (not shown) 
through a pixel bus interface 1222. 
[0030] The aforementioned series of processing is 
executed in units of segments, similarly to the case of 
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encoding. The Inverse quantizer 1214, the scan con- 
verter 1216, the inverse discrete cosine converter 1218 
and the pixel reconfigurator 1220 are pipelined, in order 
to process the picture data at a high speed. 
[0031] A control circuit 1226 controls the access to s 
the external memory 1230 and starting and stoppage of 
the pipeline stage. 

[0032] Fig. 34 illustrates storage areas of the exter- 
nal memory 1230 shown in Fig. 33. This external mem- 
ory 1230 is formed by a DRAM (dynamic random io 
access memory), for example, and includes a FIFO 
area 1232 storing an extemaOy supplied bit stream In 
the FIFO fashion, a reference picture area 1234 storing 
reference (prediction) picture pixel data employed for 
prediction decoding (DPCM decoding) processing in the is 
pixel reconfigurator 1230 (Fig. 33), and a display picture 
area 1236 storing display picture data to be displayed 
on a display unit through the display control circuit (not 
shown in Fig. 33). The FIFO area 1230 is generally 
called a rate buffer for rate adjustment for absorbing dtf- 20 
fere nee between the bit rate of the incoming bit stream 
and the data processing speed in the picture decocBng 
circuit 1200 (Fig. 33). Due to the employment of the 
FIFO area 1232, it Is possible to compensate for differ- 
ence in code quantity required in a unit time in picture 25 
expansion processing due to processing of variable 
length code word data while the transmission rate of the 
incoming bit stream is kept substantially constant 
[0033] Fig. 35 illustrates an exemplary timing chart 
in relation to control of the picture decoding circuit so 
shown in Fig. 33. This figure shows a picture synchro- 
nizing signal which Is a synchronizing signal indicating 
starting of an operation in units of frame or field pictures, 
and an MB synchronizing signal which is a synchroniz- 
ing signal indicating starting of an operation in units of as 
segments. The picture synchronizing signal, which is a 
vertical synchronizing signal, for example, Is supplied to 
the control circuit 1226 shown in Rg. 33 from the display 
control circuit (not shown). The control circuit 1226 out- 
puts the MB synchronizing signal in synchronization 40 
with the picture synchronizing signal. The cycle of the 
picture synchronizing signal has a constant value which 
is decided by a display rate of decoded picture data 
(pixel data read through the pixel bus interface 1222 
shown in Fig. 32) on the display unit This display rate is 45 
decided by a level in the MPEG standard. The maxi- 
mum values of the number of horizontal pixels, the 
number of vertical pixels and the frame frequencies are 
standardized in the "level". In a single picture, the 
number of divided macro blocks is previously deter- so 
mined Therefore, the number of MB synchronizing sig- 
nals asserted in a picture synchronizing signal cycle is 
determined by the pixel number of the picture, La, the 
number of macro blocks in a single picture. This MB 
synchronizing signal is supplied to each circuit of the ss 
picture decoding circuit 1220 from the control circuit 
1 226 shown in Fig. 33, so that each circuit executes pre- 
scribed processing synchronously. 



[0034] Fig. 36 is a timing chart showing processing 
which is carried out in a segment unit processing sec- 
tion. This figure shows the picture decoding circuit as a 
decoder. An operation of this picture decoding circuit 
(decoder) is started in synchronization with the MB syn- 
chronizing signal. The variable length decoder 1212 
(see Rg. 33) is activated in synchronization with the MB 
synchronizing signal to detect and analyze headers 
from the bit stream supplied through the FIFO interface 
1210, thereby deciding the processing to be subse- 
quently executed. Then, decoding of actual data (here- 
inafter referred to as decoding of block data) of 
respective blocks of macro blocks is carried out in 
accordance with the processing operation decided by 
the header analysis. 

[0035] In parallel with the decoding operation in the 
decoder, executed is access to the external memory 
1230, including writing of the bit stream in the FIFO area 
1232 shown in Rg. 34, reading of pixel data from the 
FIFO area 1232 as to the bit stream to be decoded, writ- 
ing of the decoded picture data in the reference picture 
area 1234 or the display picture area 1236 (B pictures 
are not employed as reference (prediction) pictures), 
reading of data from the display picture area 1236 of the 
external memory for display of the picture data, and 
reading of predicting picture data employed for predic- 
tive encoding/decoding processing in the pixel reconfig- 
urator 1220 from the reference picture area 1234. 
[0036] Fig. 36 also shows the processing operation 
of a single macro block. In the following description, it is 
assumed that the term •segment" includes both of a 
macro block Including a plurality of blocks, and a macro 
block header including attribute data of the macro block, 
and the term "macro block" simply includes a plurality of 
data blocks. 

[0037] A header analysis part decodes a header 
part of the segment, and decides processing to be sub- 
sequently executed and attributes of the macro block to 
be processed. After the decoding of the header part of 
the macro block, luminance signals (Y signals) and 
chrominance signals Cb and Cr of respective blocks of 
the macro block are decoded. At this time, an operation 
of reconfiguring motion vectors from those obtained by 
the decodng of the macro block header part is carried 
out in parallel (a plurality of motion vectors are 
employed in the case of B pictures). An exemplary 
decoding operation of such a decoder is described In "A 
Single-Chip MPEG2 Video Decoder LSI" by Demura et 
al., ISSCC 94, Digest of Technical Papers, pp. 72 to 73, 
Fig. 2, for example. In the case of this processing, there- 
fore, the time required for the header analysis depends 
on the length of the header part, and hence the period 
of the MB synchronizing signal, i.e., the time length of a 
single processing section differs for different processing 
sections. 

[0038] In the picture decoding circuit, the bit stream 
is processed in units of segments. As shown in Fig. 30, 
headers are provided on heads of the respective layers 
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excluding the block layer. Start codes indicating starting 
of the layers are arranged on the head portions of the 
headers. Each start code 1300 has a width of 32 bits 
which are arranged In units of bytes, as shown in Fig. 
37. s 
[0039] Referring to Fig. 37, the start code 1300 
includes a 3-byte prefix 1310 having a prescribed pat- 
tern Indicating that this is a start code, and a 1-byte 
layer start code 1320 having a pattern which is specific 
to each layer. For example, a start code indicating start- to 
ing of a picture layer of the MPEG2 standard has the fol- 
lowing pattern: 

0000 0000 0000 0000 0000 0001 0000 0000 

is 

while a start code indicating starting of a sequence layer 
has the following pattern: 

0000 0000 0000 0000 0000 0001 1011 0011 

2D 

In the aforementioned start codes, the prefix is formed 
by upper 24 bits (3 bytes), and the layer start code is 
formed by a lower byte (8 bits). 
[0040] In the MPEG2 standard, header information 
is arranged following the start code in each layer which 25 
is higher In order than the macro block layer. No start 
code is arranged on the macro block layer. The header 
information is fixed length data, while detailed descrip- 
tion thereof is omitted. The header (macro block 
header) of the macro block layer includes variable- x 
length encoded information. 

[0041] Fig. 38 illustrates an exemplary structure of 
a macro block header 1350. Referring to Fig. 38, the 
macro block header 1350 includes a macro block 
address area 1352 storing information (a macro block 35 
address) indicating the position of the macro block on 
the screen and the number of macro blocks to be 
skipped (macro block aottess increment), an area 1354 
storing a macro block type indicating a method of 
processing the macro block, an area 1356 storing 40 
motion vectors of the macro block, and a CBP area 
1358 storing CBP (coded block pattern) indicating 
whether or not respective blocks of the macro block 
other than in I pictures include DCT coefficient data. 
[0042] Trie macro blocks which are skipped by the 4s 
macro block address increment are those having no 
codes of DCT coefficients among those subjected to no 
motion compensation as to P pictures, for example. The 
macro block type stored in the area 1354 Includes infor- 
mation as to whether or not the macro block is sub- so 
jected to intra-frame/intra-field predictive encoding, 
whether or not the same is subjected to motion compen- 
sation, and the like. 

[0043] The motion vector area 1356 stores motion 
vectors in the case of motion compensated prediction, ss 
In the case of I pictures, no motion vectors are stored in 
the motion vector area 1 356. In relation to P pictures, on 
the other hand, motion vectors along a prediction sys- 



tem (odd and even fields (top and bottom fields) in the 
case of frame predictive encoding system) can be 
employed. Also as to B pictures, the number of 
employed motion vectors varies according to the predic- 
tion system. Therefore, the bit width of the motion vector 
storage area 1356 differs for different segment There- 
fore, a block as to which the information stored In the 
CBP area 1358 indicates inclusion of no DCT coefficient 
data is absent in data transmission. 
[0044] The information Included in the respective 
areas 1352, 1354, 1356 and 1358 of the macro block 
header 1350 is entirely expressed by variable length 
code words (variable length symbols). Therefore, the 
time required for entirety analyzing the information of 
the macro block header 1350 varies according to the 
attributes of the macro blocks (the method of process- 
ing, the ntmber of the motion vectors etc). 
[0045] ft is possible to specify what processing is 
carried out on the macro block following the macro block 
header 1350 by analyzing the header Information. In 
general, analysis of the information of the macro block 
header 1350 is started in synchronization with the MB 
synchronizing signal (MBSYNC) as shown In Rg. 36, so 
that decoding of the macro block data is performed only 
after the information of the macro block header 1350 is 
entirely analyzed. Namely, a code decoding part of the 
variable length decoder 1212, the inverse quantizer 
1214, the scan converter 1216, the inverse discrete 
cosine converter 1 21 8 and the pixel reconflgurator 1220 
shown in Fig. 33 are kept in operation stoppage states 
after the MB synchronizing signal (MBSYNC) is 
asserted until the information of the macro block header 
1350 is entirely analyzed, and these operational proces- 
sors are brought into operating states only after the 
macro block header Information is entirely analyzed. 
Rg. 39 illustrates such a state that headers of macro 
blocks MB#A, MB#B and MB#C are completely ana- 
lyzed at times Ta, lb and Tc respectively, and then block 
data are decoded, for example. 
[0046] Therefore, when a long time is required for 
the header analysis in the macro block MB#C, for exam- 
ple, the operation stoppage times of the operational 
processors following the variable length code decoder 
are so increased that utilization efficiency of the opera- 
tional processors is reduced and the picture data cannot 
be decoded at a high speed 

[0047] In order to prevent such reduction in utiliza- 
tion efficiency of the operational processors, the opera- 
tional processing may conceivably be carried out In a 
pipeline manner. 

[0048] Fig. 40 schematically illustrates a pipeline 
which is defined by respective stages of operational 
processors from an inverse quantizer to a pixel reconfig- 
urator. In the structure shown in Fig. 40, variable-length 
decoded data having header analyzed are dispatched 
into the pipeline every assertion of MB synchronizing 
signal MBSYNC. Inverse quantization, scan conversion, 
inverse DCT and pixel decoding stages in the pipeline 
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stages process the supplied data fn a pipeline mode 
respectively. 

[0049] When header analysis and variable length 
decoding of the segnent (the macro block header and 
the macro block) MB#A are completed and a next MB s 
synchronizing signal MBSYNC is asserted, the respec- 
tive block data of the macro block MB#A are dispatched 
into the pipeline and successively processed. 
[0050] If a long time is required for header analysis 
of the next segment MB#B, data of the macro block 10 
MB#B are not yet introduced into the pipeline upon 
completion of data processing of the respective blocks 
of the macro block MB#A_ Thus, vacancy is caused in 
the pipeline stages and pipefine utilization efficiency Is 
reduced. is 
[0051] When header analysis and variable length 
decoding of the segment MB#B are completed, the data 
of variable length decoded words of the macro block 
MB#B are dispatched into the pipeline stages in accord- 
ance with assertion of a next MB synchronizing signal 20 
MBSYNC. 

[0052] If header analysis of the next segment 
MB#C is completed in a short time and variable length 
decoding for data of respective blocks of the macro 
block MB#C is also quickly completed correspondingly, 25 
a next MB synchronizing signal MBSYNC is asserted 
following completion of the variable length decoding of 
the macro block MB#C. If data processing of the respec- 
tive blocks of the macro block MB#B is not yet com- 
pleted in the inverse quantization stage of the pipeline 30 
at this time, block data of the next macro block MB#C 
are dispatched during data processing of the respective 
blocks of the macro block MB#B. Thus, the data of the 
respective blocks of the macro blocks MB#B and MB#C 
are mixed ly processed, and the data processing as 
(expansion processing) cannot be correctly performed 
but breaks down. Thus, a large pipeline cannot be Intro- 
duced, and improvement of utilization efficiency of the 
operational processors through the use of the pipeline is 
limited. 40 
[0053] In a picture decoding circuit for processing 
moving picture data, particularly data of pictures having 
a large screen size of HDTV (high definition television) 
or the like, it is necessary to process a large quantity of 
data at a high speed (the frequency of a frame or a field, 45 
i.e., the cycle of this picture synchronizing signal is 
decided by the display speed for the picture data after 
expansion), and the amount of operations at operational 
processors (such as an inverse OCT converter, for 
example) in the expansion procedure becomes so 
extremely large. In order to compensate for reduction of 
utilization efficiency of the operational processors and 
implement high-speed data processing, therefore, it is 
necessary to increase the operating speeds of the 
respective operational processors (increase the fre- ss 
quencies of clock signals deciding the operational 
processing speeds). Thus, the number of on and off 
times of the elements forming the operational proces- 



sors and the number of charging and discharging times 
of signal lines per unit time are increased, leading to 
increase of current consumption. 
[0054] As another method, it is also conceivable to 
provide a plurality of operational processors in parallel 
with each other and simultaneously drive the same in 
parallel with each other thereby compensating for 
reduction of utilization efficiency. In this case, however, 
the element number is disadvantageous^ increased to 
increase the device scale. 

[0055] When interruption processing from an exter- 
nal control unit is caused during the picture expansion 
procedure, for example, ft is necessary to initialize the 
picture decoding circuit after completion of the interrup- 
tion. If the processing is restarted from the interrupted 
state, however, display is performed from an intermedi- 
ate stage of the picture. In this case, it may be impossi- 
ble to synchronize processing of the subsequent picture 
with the display on the display unit If first picture display 
is executed immediately after initialization in synchroni- 
zation with the picture synchronizing signal such as the 
vertical synchronizing signal, for example, pictures out 
of synchronization are thereafter displayed (boundaries 
between the pictures are displayed on the screen). In 
the MPEG standard, a sequence header is arranged on 
the head of each GOP (group of pictures) to allow repro- 
duction from an arbitrary GOP. However, no processing 
to be executed in resetting (initialization) of the picture 
expansion procedure is mentioned. Further, no prior art 
mentions such an operation of initialization of picture 
expansion processing. 

SUMMARY OF THE INVENTION 

[0056] An object of the present invention is to pro- 
vide a picture decoding circuit which can efficiently exe- 
cute expansion of picture data. 
[0057] Another object of the present Invention is to 
provide a picture decoding circuit including an efficiently 
operating pipeline stage. 

[0058] Still another object of the present invention is 
to provide a picture decoding circuit which is excellent in 
utilization efficiency of operational processors. 
[0059] A further object of the present invention is to 
provide a picture decoding circuit which can reliably 
execute processing from a first macro block of a picture 
In resetting (in initialization and re-synchronization) 
without reducing processing efficiency. 
[0060] A picture decoding circuit according to a first 
aspect of the present invention includes a header 
decoder receiving an incoming bit stream and analyzing 
information of a header of a segment, a controller gen- 
erating a data processing start indication signal in 
response to a signal indicating completion of analysis of 
the segment header information from the header 
decoder, and a data processor which is activated in 
response to the data processing start indication signal 
for executing predetermined processing on a data block 
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of the segment following the header The header 
decoder continuously analyzes data of a header which 
is supplied following the data block, whereby one 
processing section is started from processing of the 
data block and ended in analyse of the header. 5 
[0061 ] A picture decoding circuit according to a sec- 
ond aspect of the present invention includes an ana- 
lyzer detecting a header of a segment from a supplied 
bit stream for analyzing this header information. This 
analyzer Includes a circuit generating a signal indicating 10 
completion of analysis of all the header information. 
[0062] The picture decoding circuit according to the 
second aspect further includes a data processor includ- 
ing a portion for generating fixed length code data by 
carrying out variable length decoding on data of a data is 
block following the header of the segment for restoring 
the data of the data block in accordance with the result 
of analysis of the analyzer, an error detector generating 
an error detection signal indicating an error which is 
detected in the processing of either the analyzer or the 20 
variable length decoder, code detector detecting a start 
code having a predetermined pattern from the incoming 
bit stream In response to the error detection signal, an 
activator activating the analyzer In response to a code 
detection signal from the code detector, and a delayer 25 
for delaying activation of the data processor until pre- 
scribed conditions are satisfied in response to an analy- 
sis completion indication signal from the analyzer in 
activation of the error detector. 

[0063] A picture decoding circuit according to a x 
third aspect of the present invention includes a control- 
ler generating a processing start signal in response to a 
reset request signal requesting initialization of picture 
expansion processing, code detector detecting a start 
code having a predetermined pattern from an incoming as 
bit stream in response to the processing start signal 
from the controller, a header analyzer detecting a seg- 
ment from the incoming stream in response to a code 
detection signal from the code detector in code detec- 
tion for analyzing information of its header and general- 40 
ing a signal indicating that all analysis of the head 
information is completed, and a stop control for stopping 
the operation of data processor carrying out processing 
of a data block of the segment until prescribed condi- 
tions are satisfied in response to the header analysis 45 
completion indication signal. 

[0064] In the picture decoding circuit according to 
the first aspect, the header is analyzed following decod- 
ing of the data block, and starting of data processing is 
instructed after the header is entirely analyzed. One so 
processing section is started at processing of the data 
block and ended at analysis of the header. When the 
data processing start is designated, the data processor 
immediately executes processing. Therefore, the stop 
period of the operational processor Is reduced and the ss 
utilization efficiency thereof is improved. Further, the 
standby time of the operational processor is reduced, 
whereby the time period of one processing section can 



be reduced to implement high-speed processing. 
[0065] In the picture decoding circuit according to 
the second aspect, a start code having a prescribed 
pattern is detected when an error is caused in a header 
analysis or variable length decoding process and the 
header of a segment following the start code is ana- 
lyzed, and the start of processing of a data block follow- 
ing the analyzed header Is delayed until a prescribed 
condition is satisfied after completion of the analysis. 
Processing is started from a prescribed segment even 
in occurrence of an error and the processing section is 
started at processing of the data block in the restarting 
of the processing, whereby reduction of utilization effi- 
ciency of the operational processor can be also sup- 
pressed in starting of the processing after recovery from 
the error. Further, ft Is possible to maintain such regular- 
ity that the processing section is started at decoding of 
the data block. 

[0066] In the picture decoding circuit according to 
the third aspect, a start code having a prescribed pat- 
tern is detected upon request for resetting, and a 
header of a segment following the start code is ana- 
lyzed and the subsequent processing is stopped until 
establishment of the prescribed condition. Also in 
request for resetting, processing can be reliably started 
from a macro block of a segment of a desired position. 
[0067] The foregoing and other objects, features, 
aspects and advantages of the present invention will 
become more apparent from the following detailed 
description of the present invention when taken in con- 
junction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0068] 

Rg. 1 schematically illustrates an operation In one 
processing section of a picture decocOng circuit 
according to the present invention; 
Figs. 2A and 2B illustrate the structure of one 
processing section (unit) of the picture decoding cir- 
cuit according to the present invention and an effect 
of pipeline arrangement; 

Rg. 3 illustrates the operations of one processing 
section of the picture decoding circuit and a DRAM 
port according to the present invention; 
Rg. 4 illustrates other operation sequences of the 
picture decoding circuit and the DRAM port accord- 
ing to the present invention; 
Rg. 5 illustrates structures of input and output sig- 
nals in and from an inverse quantizer which is 
employed in the picture decoding circuit according 
to the present invention; 

Rg. 6 illustrates the relations between the input and 
output signals of the inverse quantizer shown in Rg. 

5; 

Rg. 7 illustrates a pipeline structure of operational 
processors of the picture decoding circuit according 
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to the present Invention and a processing sequence 
for block data; 

Rg. 8 is a flow chart representing an operation for 
setting the time period of one processing section in 
the picture decoding circuit according to the present s 
invention; 

Rg. 9 illustrates another operation sequence for 
deciding one processing section in the picture 
decoding circuit according to the present invention; 
Rg. 10 is a flow chart representing an operation in w 
an error state in the picture decoding circuit accord- 
ing to the present invention; 
Rg. 11 illustrates the structures of a header of a 
segment and a start code accompanying the same 
employed in the present invention; is 
Rg. 12 illustrates the structure of a part of the pic- 
ture decoolng circuit according to the present 
invention which Is related to the operation in an 
error state; 

Rg. 13 Illustrates an operation sequence of the 20 
structure shown in Rg. 12 in an error state; 
Rg. 14 illustrates another operation sequence of 
the structure shown in Rg. 12 in an error state; 
Rg. 1 5 illustrates the internal structure of a variable 
length decoder shown in Rg. 12; 25 
Rg. 16 is a block diagram showing the Internal 
structure of a control unit shown in Rg. 12; 
Rg. 17 illustrates the structure of a pixel reconfigu- 
rator in the picture decoding circuit according to the 
present invention; so 
Rg. 18 illustrates an operation sequence in an error 
state in the picture decoding circuit according to the 
present invention; 

Rg. 19 illustrates an error concealment processing 
In the picture decoding circuit according to the as 
present invention; 

Rg. 20 illustrates another structure of the pixel 
reconflgurator in the picture decoding circuit 
according to the present invention; 
Rg. 21 illustrates the structure of a scan converter 40 
shown In Rg. 20; 

Rg. 22 illustrates still another operation sequence 
In an error state in the picture decoding circuit 
according to the present invention; 
Rg. 23 illustrates an error concealment processing 45 
in the operation sequence shown in Rg. 22; 
Rg. 24 is a flow chart representing an operation in 
resetting (restarting) of the picture decoding circuit 
according to the present invention; 
Rg. 25 is a flow chart representing art operation in so 
resetting (initialization) of the picture decoding cir- 
cuit according to the present invention; 
Rg. 26 illustrates an exemplary operation sequence 
in resetting of the picture decoding circuit according 
to the present invention; 55 
Rg. 27 illustrates a structure for generating a varia- 
ble length code which the present invention proc- 
esses; 



Rg. 28 illustrates a picture arrangement In a GOP 

layer utilized in a picture decoding circuit to which 

the present invention is applied; 

Rg. 29 illustrates the structure of picture data to 

which the present invention is applied; 

Rg. 30 illustrates the syntax of picture data to which 

the present invention is applied; 

Rg. 31 illustrates a slice layer shown in Rg. 30; 

Rg. 32 illustrates the structure of a block layer 

shown In Rg. 30; 

Rg. 33 is a block diagram schematically showing 
the structure of a picture decoding circuit to which 
the present invention is directed; 
Rg. 34 illustrates the structure of storage areas of 
an external memory shown in Fig. 33; 
Rg. 35 illustrates a processing section of a conven- 
tional picture decoding circuit;. 
Rg. 36 illustrates an operation of the conventional 
picture decoding circuit; 
Rg. 37 illustrates the structure of a start code; 
Rg. 38 illustrates the structure of a header part of a 
macro block layer; 

Rg. 39 illustrates a problem In the conventional pic- 
ture decoding circuit; and 
Rg. 40 illustrates another problem in the conven- 
tional picture decoding circuit 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0069] Rg. 1 illustrates an operation in one 
processing section PS1 of a variable length decoding 
part in a picture decoding circuit according to the 
present invention. The processing section PS1 of a var- 
iable length decoding part (hereinafter referred to as a 
decoder (VLD)) includes a decoding period PS2 for 
decoding data of respective blocks of a macro block, 
and a period PS3 following the decoding period PS2 for 
analyzing header information. The decoding period PS2 
is started in response to assertion of an MB synchroniz- 
ing signal MBSYNC, to decode the block data consist- 
ing of a variable length symbol group on the basis of a 
quantization Index. In the header analysis period PS3, 
information of a header part (sequence and picture 
headers may be included in addition to a macro block 
header) for a next processing section is entirely ana- 
lyzed. After completion of the analysis period PS3, I.e., 
after completion of analysis of all information of the next 
macro block header, starting of the next processing sec- 
tion PS1, i.e., decoding processing of data of blocks of 
the next macro block, is delayed until prescribed condi- 
tions are established. Referring to Rg. 1 , the block data 
of the next macro block are decoded following comple- 
tion of the analysis period PS3. However, the time 
period of the analysis period PS3 varies depending on 
the header information. Decoding processing of 
encoded block data (the data of the respective blocks of 
the macro block) is completed in a fixed constant time. 
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The data of the respective blocks of the macro block are 
variable-length encoded, with different code lengths. 
When the variable length codes are decoded at a 1 
symbol/1 clock cycle rate, for example, each block of the 
macro block has 8 by 8 pixels, and the maximum 5 
number of the symbols per block is 64. When the time 
period of the decoding period PS2 Is set in the afore- 
mentioned manner, therefore, a fixed time length can be 
attained. When variable-length encoding is carried out 
at the rate of 1 symbol/1 dock cycle, run-length data are 10 
decoded and OCT coefficients of the respective blocks 
are successively obtained along the decoded run-length 
information. In this case, therefore, the maximum value 
of the time required for the run-tength decoding can be 
previously determined, and if the time required for such l5 
run-tength decoding is previously set at a constant 
value and when DCT coefficient data of the blocks are 
obtained at a rate of one pixel per clock from the 
decoded run-tength information, the time period is fixed 
also In this case. Also when the time required for the 20 
run-length decoding is varied and accordingly the time 
period of the decoding period PS2 fluctuates, the time 
period required for decoding the block data can be sup- 
pressed within a constant time (about the maximum 
decoding time). The decoder (VLD) outputs DCT coeffi- 2s 
dents (quantization index) of fixed lengths. 
[0070] According to the structure of the processing 
period shown in Rg. 1, the following advantages are 
obtained: The data of the blocks of the macro block are 
decoded in synchronization with the MB synchronizing so 
signal MBSYNC. Therefore, each computing element 
inducted In the picture decoding drcuit can start its 
operation after completion of header analysis with no 
standby time. Therefore, an inverse quantizer, a variable 
length decoder, a scan converter, an inverse discrete ss 
cosine converter and a pixel reconfigurator can start 
processing with no delay (particularly when the ele- 
ments construct a pipeline), whereby utilization effi- 
ciency of various computing elements of the picture 
decoding circuit can be improved. 40 
[0071] Further, the time periods of the decoding 
period PS2 and the analysis period PS3 can be remark- 
ably reduced by driving various operational processors 
inducted in the picture decoding drcuit in a pipeline 
manner as described later. as 
[0072] Figs, 2A and 2B specifically illustrate the 
structure of each processing section. Referring to Fig. 
2A, the decoding period PS2 of one processing section 
includes variable length decoding processing (VLD) for 
variable-length decoding variable length codes and so 
generating quantized DCT coeffidents of fixed lengths, 
inverse quantization processing (IQ) on the variable- 
length decoded DCT coefficient data, scan conversion 
processing carrying out conversion of scan order of the 
inverse-quantized DCT coeffidents, inverse discrete ss 
cosine transformation processing (I DCT) of the scan- 
converted data, and pixel restoration processing 
(DPCM: differential PCM) for restoring original pixel 



data from the pixel data after the inverse discrete cosine 
transformation. Referring to Fig. 2A, the time period of a 
decoding period in the processing section is the total 
sum of times required tor the respective processing 
operations. 

[0073] Fig. 2B illustrates an exemplary structure In 
the case of executing the respective processing opera- 
tions Inducted in the decoding period 2 in a pipeline 
manner. When the variable length decoding processing 
(VLD) is completed, the header information can be ana- 
lyzed in the variable length decoder. Therefore, header 
information of a next segment can be analyzed in paral- 
lel with the inverse quantization processing (IQ), the 
scan conversion processing (write/read of data to a 
buffer memory, accompanying address conversion), the 
inverse discrete cosine transformation processing 
(IDCT) and the pixel restoration processing (DPCM). 
Thus, reduction of the time periods of the decoding 
period PS2 and the analysis period PS3 can be imple- 
mented by carrying out the processing in the pipeline 
mode due to parallel processing of the header informa- 
tion analysis and decoding of block data through the 
pipeline, the time period for one processing section can 
be remarkably reduced, and high-speed arithmetic 
processing (expansion) can be executed. The structure 
of the pipeline is described later again in detail. 
[0074] The external structure of the picture decod- 
ing drcuit according to the present invention is schemat- 
ically Identical to the structure shown In Rg. 33. Internal 
structures of a variable length decoder 1 21 2 and a con- 
trol drcuit 1226 are different. These structures are 
described later in detail. 

[0075] Rg. 3 illustrates operations of the decoder 
(picture decoding drcuit) and a port of an external mem- 
ory device (DRAM). Referring to Rg. 3, decocfing of 
block data of the segment is started in response to 
assertion of the MB synchronizing signal MBSYNC in 
the picture decoding drcuit (decoder). When the decod- 
ing of the block data is completed, header information of 
the next segment is analyzed. One processing unit time 
period is just ended when analysis of the header infor- 
mation is completed, and decoding of block data of the 
macro block of the next segment is started. 
[0076] With respect to the DRAM, on the other 
hand, pixel data decoded In a precedent processing unit 
time period (section) are first written in response to 
assertion of the MB synchronizing signal MBSYNC. 
Then, an externally supplied bit stream is written in a 
predetermined time period through the RFO Interface 
1210 shown in Rg. 32. When the writing of the bit 
stream in the DRAM port (writing in a rate buffer) is 
completed, picture data for display are then read out 
When the reading of the picture data for display (pixel 
data of the macro block, for example) is completed, pre- 
dictive picture data employed for restoration of predic- 
tion encoded pixel data are then read out In such 
reading of the predictive picture data, picture data of two 
pictures which are precedent and subsequent in time 
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are read In the case of interpolation prediction, for 
example, in the case of B pictures. Therefore, the read- 
ing of the predictive picture data varies depending on 
the encoding mode of the block data to be decoded. 
[0077] When the reading of the predictive picture s 
data is completed, the bit stream to be processed is 
then read out (reading of the rate buffer). In the reading 
of the rate buffer, the quantity of read data is previously 
set It is necessary that the bit stream employed for 
analysis of the header information In the processing unit 10 
carrying out reading of the rate buffer and the block data 
of the segment decoded in the next processing unit 
(section) are prepared in a buffer included in the varia- 
ble length decoder whfch is described later, ft is possible 
to guarantee storage (prefetch) of the bit stream is 
employed for the header analysis in the corresponding 
processing section and the block data employed In the 
next processing section in a buffer memory included in 
the variable length decoder by reading the bit stream 
from the rate buffer In each processing (unit) section. 20 
Here, one processing unit corresponds to one process- 
ing section. 

[0078] After the reading of the rate buffer, DRAM 
refreshing is carried out, and refreshing of memory data 
stored In the DRAM which is an external memory device 25 
is executed. In the operation of the DRAM port, the 
aforementioned operations are successively executed 
in a single processing unit time. In the operation 
sequence shown in Fig. 3, no access is made until the 
next processing section is started after completion of ao 
the DRAM refreshing operation, and the DRAM port 
enters an empty (wait) state. The DRAM refreshing is 
illustrated as being carried out last in one processing 
section. However, this DRAM refreshing may be exe- 
cuted at proper timing in the section of one processing as 
unit 

[0079] Fig. 4 illustrates another sequence of opera- 
tions of the picture decoding circuit and the DRAM port 
in one processing section. Referring to Fig. 4, decoding 
of the block data (data of the respective blocks of the 40 
macro block) is carried out in the picture decoding cir- 
cuit (decoder) in synchronization with assertion of the 
MB synchronizing signal MBSYNC similarly to the 
sequence shown in Fig. % and then header information 
of the next segment is carried out after completion of the as 
decoding. In the sequence shown in Rg. 4, starting of 
decoding processing of the block data of the next seg- 
ment is delayed after completion of analysis of the 
header information. 

[0080] In the DRAM port, on the other hand, writing 50 
of decoded data, writing in the rate buffer, reading of 
picture data for display, reading of predictive picture 
data and reading of the rate buffer are successively exe- 
cuted in synchronization with assertion of the MB syn- 
chronizing signal MBSYNC. DRAM refreshing is ss 
executed before the reading of the rate buffer. This 
DRAM refreshing can be executed in one processing 
section at arbitrary timing, as described above. One 



processing section is completed by completion of the 
reading of the rate buffer. In response to the completion 
of the processing section, the MB synchronizing signal 
MBSYNC is asserted In order to Instruct starting of 
decoding of the block data of the next segment An 
empty period between the analysis of the head informa- 
tion and the starting of decoding of the next block data 
is described later in detail. 

[0081] The writing of the decoded data, the writing 
in the rate buffer, the reading of the picture data for dis- 
play, the reading of the predictive picture data and the 
reading of the rate buffer are carried out with respect to 
the DRAM port in the prescribed order in this process- 
ing section, whereby it is not necessary to discriminate 
the priority of the accesses to the DRAM or to provide a 
bus arbiter for adjusting the accesses to the DRAM, and 
the device structure is simplified. 
[0082] Further, ft is possible for the processing 
operations to be adapted for the pipeline structure of the 
operational processors of the picture decoding circuit 
described later in detail, by writing the decoded data 
first in the processing section. In addition, it is possible 
to prepare picture data which are necessary for the sub- 
sequently executed reading of the picture data for dis- 
play in the DRAM by writing the decoded data in 
advance. Namely, the decoded data are immediately 
displayed in the case of B pictures (the B pictures are 
not employed as predictive pictures). It is possible to 
write the bit stream In the rate buffer without changing 
the operation mode (write mode/read mode) of the 
DRAM and with no delay of the externally supplied bit 
stream by writing the bit stream in the rate buffer subse- 
quently to the writing of the decoded data. It is not nec- 
essary to stall the operation of the display control unit 
which is separately provided in the exterior, since the 
picture data for display are read in advance of the read- 
ing of the predictive picture data. Namely, the number of 
the predictive pictures to be read varies depending on 
the processing method (predictive encoding) for the 
segment in the reading of the predictive picture data. 
Therefore, the time required for completion of the read- 
ing of the predictive picture data varies with the type of 
picture. Thus, It is possible to supply the display picture 
data to the display control unit substantially at the same 
timing in each respective processing section by reading 
the picture data for display in advance of reading of the 
predictive picture data having a different timing of com- 
pletion in one processing section, and utilization effi- 
ciency of the display control unit is not damaged. 
[0083] The bit stream is read from the rate buffer at 
the last of the processing section with no problem, since 
only supply to the variable length decoder (1212: see 
Fig. 33) of a bit stream which is required for block data 
decoding processing and header analysis in the next 
section is required. The predictive picture data are read 
in advance of the reading of the rate buffer, so that the 
predictive picture data can be reliably loaded In the 
buffer memory which is provided in the pixel reconfigu- 
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rator of the picture decoding circuit and the arithmetic 
processing of forming the predictive pictures can be reli- 
ably executed subsequently in synchronization with 
starting of the next processing section. 
[0084] The access to the DRAM port is started in 5 
synchronization with the MB synchronizing signal 
MBSYNC, whereby the read timing for the predictive 
picture data can be previously predicted and bus control 
is simplified (access control to the DRAM is carried out 
by the control circuit 1226 shown in Rg. 32, the struc- 
ture of which is descrfoed later in detail). Namely, it is 
possible to recognize the type of the macro block and its 
position on the screen by analyzing the header informa- 
tion In advance. The DRAM has the structure of a frame 
memory Therefore, it is possible to previously predict 
change of row addresses etc. in the writing of the 
decoded data and the reading of the picture data for dis- 
play by analyzing the header information in advance, 
whereby the times required for the writing of the 
decoded data and the reading of the picture data for dis- 
play can be predicted in response and the read timing 
for the predictive picture data can be predicted in 
response. Thus, control of the memory interface shown 
in Fig. 32 and the loading operation of the predictive pic- 
ture data in the pixel reconfigu rator can also be arbitrat- 
ed fy carried out 

[0085] Fig. 5 schematically illustrates the structure 
of the inverse quantizer forming the pipeline in units of 
clock cycles. This inverse quantizer 1214 receives 
quantized DCT coefficient data consisting of variable- 
length decoded fixed length data through an input bus 
A101 while receiving an input synchronizing signal indi- 
cating starting of each block (each block of the macro 
block) through a signal line A103, carries out inverse 
quantization processing in a pipeline mode, and outputs 35 
DCT coefficient data from an output bus A1 02 white out- 
putting an output synchronizing signal indicating start- 
ing of the block of the output data through a signal line 
A104. 

[0086] The inverse quantizer 1 21 4 carries out arith- 40 
metfc processing inverse to that in quantization on the 
quantized DCT coefficients which are converted to fixed 
length codes using a previously prepared quantization 
table (for example, it carries out multiplication with cor- 
responding coefficients of the quantization table: when 45 
division is made by corresponding coefficients of the 
quantization table in quantization). At this time, multipli- 
cation processing is executed in a pipeline manner. In 
general, this inverse quantizer 1214 comprises a pipe- 
line having 128 extra stages as compared with the VLD, so 
I DCT and DPCM processing stages, as shown in Rg. 6. 
When the input synchronizing signal is supplied through 
the signal line A103 and the data are successively sup- 
plied through the input bus A101 as shown in Fig. 6, 
therefore, inverse-quantized data are o inputted after a ss 
lapse of 128 cycles. The input data supplied to the 
inverse quantizer 1214 are provided by the variable 
length decoder 1212 shown in Fig. 33. Before all output 



data appearing at the output bus A102 from the Inverse 
quantizer 1214 are oulputted, or before the same are 
supplied to an inverse DCT device through the scan 
converter as shown in Fig. 2B, the input data are ended 
in advance of at least 128 cycles. During this period, 
therefore, the variable length decoder can be utilized for 
header analysis. Thus, the processing following the 
inverse quantizer and the header analysis can be exe- 
cuted in parallel with each other (see Rg. 2B). 
[0087] Fig. 7 illustrates another pipeline mode for 
the picture decoding circuit In the picture decoding cir- 
cuit shown In Fig. 7, pipeline processing is executed by 
a pipeline of four stages in synchronization with the MB 
synchronizing signal MBSYNC. Referring to Fig. 7, the 
first stage pipeline reads a predictive picture from the 
DRAM, variable-length decodes the DCT coefficients 
(formation of fixed length DCT coefficient data), and 
carries out inverse quantization processing. In the read- 
ing of the predictive picture data from the DRAM, motion 
vectors are extracted from header information analyzed 
in a precedent processing section, so that the predictive 
picture data are read from the DRAM in accordance 
with the extracted motion vectors. 
[0088] The second pipeline stage carries out filter 
processing of the predictive picture data read from the 
DRAM. In the filter processing of the predictive pictures, 
a plurality of predictive pictures in the case of fractional 
prediction accuracy are synthesized (averaged) by 
interpolation. In the case of B pictures of Interpolation 
prediction, picture data of two pictures which are prece- 
dent and subsequent in time are synthesized with each 
other (the picture data are synthesized with weighting 
according to respective time distances). Thus, the pre- 
dictive picture data are formed. 
[0089] The third pipeline stage carries out inverse 
discrete cosine transformation processing (I DCT) and 
predictive difference code decoding processing (DPCM 
decoding). In the I DCT processing. Inverse discrete 
cosine transformation processing of DCT coefficient 
data subjected to inverse quantization processing (IQ) 
is executed. In the DPCM decoding process, predictive 
differential encoding (addition) of pixel data formed by 
the I DCT processing and predictive picture data formed 
by predictive picture filter processing is carried out, to 
form original pixel data When the macro blocks are I 
pictures, the I DCT processed data correspond to the 
original pixel data (when no DC prediction is made). The 
DPCM decoded and restored pixel data are written in 
the buffer which is included in the picture decoding cir- 
cuit 

[0090] The fourth pipeline stage writes the decoded 
picture data in the DRAM. Namely writing into the 
DRAM is carried out from the buffer. 
[0091] ft is possible to remarkably reduce the time 
period of the processing unit by carrying out the 
processing of the picture decoding circuit, following the 
header analysis in a pipeline manner in units of seg- 
ments (macro blocks). Assuming that the MB Synch TO- 
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nizing signal MBSYNC is asserted at an interval of one 
processing section in Fig. 7, and therefore four process- 
ing sections are required for decoding block data of one 
macro block. Analysis of the header information is exe- 
cuted in each processing section. Fig. 7 shows an oper- 5 
ation sequence in the case of processing a digital NTSC 
signal (720 valid pixels/line, 480 lines/frame) in units of 
macro blocks each consisting of 16 by 16 pixels every 
frame, for example. First to 1350-th macro blocks MB#1 
to MB#1350 are processed by the four stage pipelines w 
in the units of segments (one segment (macro block) is 
processed In one processing section). 
[0092] Rg. 7 also shows access to the DRAM port 
in the case of carrying out the internal arithmetic 
processing operation in the picture decoding circuit in a 15 
pipeline manner, in correspondence to the pipeline 
stages in the picture decodng circuit 
[0093] As shown In Fig. 7, processing of the seg- 
ments which are the units of picture expansion process- 
ing can be executed in a pipeline manner over a plurality 20 
of processing sections due to the pipelined processing 
of the respective operational processors of the picture 
decoding circuit in units of segnents, whereby the time 
required for all processing of one segment (time for one 
processing unit) can be effectively reduced. As shown in 25 
Fig. 7, one segment is processed in a processing sec- 
tion of a time of about 1/4 one processing unit, in the 
case of the four stage pipeline structure. 
[0094] The time period of the processing section 
shown in Rg. 7 may be fixed to a constant clock cycle 30 
number. However, it is also possible to change the time 
period (dock cycle number) of the processing section in 
accordance with the attributes of the segment 
[0095] Fig. 8 illustrates an operation flow for chang- 
ing the time period of the processing section. With refer- as 
ence to Fig. 8, a method for changing the clock cycle 
number of the processing section is now descrfoecL 
[0096] First, the MB synchronizing signal MBSYNC 
is asserted (step S1). In response to this assertion of 
the MB synchronizing signal MBSYNC, a timer included 40 
in the control circuit 1226 (see Fig. 33) Is started of 
counting (step S2). 

[0097] After the timer operation Is started, a deter- 
mination is made as to whether or not it Is necessary to 
change a set time on the basis of the header information 45 
analyzed in the precedent processing section (step S3). 
When the processing method for the macro blocks is 
complicated (in the case of B pictures subjected to bidi- 
rectional predictive encoding with motion prediction in 
fractional accuracy, for example), the processing unit so 
time period Is increased. In this case, the set time is 
increased in accordance with the analyzed header infor- 
mation. When a determination is made that the change 
of the set time is necessary at the step S3, the time of 
the processing section is set at a proper value (long or ss 
short) in accordance with the analyzed header informa- 
tion. When a determination is made that the set time 
needs not be changed at the step S3, on the other hand, 



set time change processing at a step S4 is skipped. 
Then, a determination is made as to whether or not the 
count time of the timer reaches the set time (step S5). If 
the set time elapses, the process returns to the step S1 , 
so that the MB synchronizing signal MBSYNC indicating 
starting of the next processing section is asserted. The 
step S5 is repetitively executed up to a lapse of the set 
time. 

[0098] The steps S3 and S4 may be carried out in 
parallel with the step S1. As to the change of the set 
time, if the timer is formed by a counter and a stored ref- 
erence value of a register and the count of the counter 
is compared by a comparator detecting matching/mis- 
matching therebetween and the MB synchronizing sig- 
nal MBSYNC is asserted in accordance with the result 
of comparison of the comparator, the reference value of 
the register is changed. When a counter of a variable 
stage number is employed and the stage number of the 
counter is changed upon changing of the set time, a 
count-up signal of the counter can be utilized as the MB 
synchronizing signal MBSYNC. 
[0099] When the time period of the processing sec- 
tion is constant, the steps S3 and S4 are omitted. 
[0100] Fig. 9 illustrates another technique of setting 
the time period of the processing section. The control 
operation shown In Rg. 9 is also executed in the control 
circuit 1226 shown in Rg. 32. The structure of the con- 
trol circuit 1226 is described later in detail. 
[0101] The processing section Is started and the 
MB synchronizing signal MBSYNC is asserted (step 
S10). Then, steps S12, S14 and S16 are executed in a 
parallel mode. At the step S1 2, a determination is made 
as to whether or not loading of the bit stream from the 
rate buffer into the variable length decoder is com- 
pleted. At the step S14, a determination is made as to 
whether or not a prescribed set time elapses from the 
assertion of the MB synchronizing signal MBSYNC. At 
the step S1 6, a determination is made as to whether or 
not analysis of header information is entirely completed. 
A signal indicating whether or not the analysis of the 
header information is entirely completed is outputted 
from the variable length decoder, as described later in 
detail. The results of these determinations are moni- 
tored at a step S1 8, so that the process returns from the 
step S18 to the step S10 if all results of the determina- 
tion at the steps S12, S14 and S16 are affirmative 
(YES), and the MB synchronizing signal MBSYNC des- 
ignating starting of the next processing section is 
asserted. 

[0102] It is possible to reliably start the next 
processing section after necessary processing is com- 
pleted by executing the processing operation shown in 
Rg. 9. It Is possible to prevent the next section from 
being started in an intermediate stage of the data 
processing (during the data read operation from the rate 
buffer or the header analysis operation, for example). As 
compared with a structure of fixedly setting the time 
period of the processing section, therefore, the series of 
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processing from the variable length decoding operation 
to the pixel restoration processing is reliably started in a 
pipeline mode after all necessary processing is com- 
pleted (after all necessary data are supplied). Referring 
to Fig. 9, the set time at the step S1 4 may be rendered 5 
changeable in accordance with the attributes of the seg- 
ments to be decoded (see Fig. 8). 
[0103] As hereinabove described, it Is possible to 
remarkably reduce the segment processing sections in 
time by bringing the respective operational processors 10 
of the picture decoding circuit into a pipeline structure in 
the units of the segments. 

Error Processing OperatfPO; 

75 

[0104] The data of the bit stream inputted in the pic- 
ture decoding circuit may include error bits. In the bit 
stream subjected to variable length encoding, lengths of 
symbols are different from each other. When an error bit 
Is mixed, therefore, an error of one symbol exerts an 20 
influence on a following symbol and hence correct vari- 
able length decoding cannot be carried out Due to the 
mixed error bit, the picture decoding circuit makes tran- 
sition from a steady, normal state of carrying out correct 
decoding to an unsteady, abnormal state incapable of 25 
carrying out correct decoding. The picture decocfing cir- 
cuit must carry out return from such an abnormal state 
to the normal state and processing of suppressing qual- 
ity deterioration of decoded pictures in the abnormal 
state to the minimum. The processing which is carried so 
out between error detection and return to the correct 
state is called error processing. Processing for reducing 
the influence by the error on the display screen which is 
carried out on the segments processed in the abnormal 
state is called "error concealment processing". The 36 
error processing operation and the error concealment 
processing are now described. 
[0105] Fig. 10 is a flow chart schematically repre- 
senting an operation of the picture decoding circuit upon 
error detection. The operation of the picture decoding 40 
circuit in error detection is now described with reference 
to Fig. 10. 

[0108] First, an error is detected at a step S20. In 
this error detection, a determination on occurrence of 
an error is made when a necessary symbol is not found 45 
in header analysis including a start code in the variable 
length decoder, or a corresponding symbol is not found 
in variable length decoding processing of the quantiza- 
tion index, for example, and an error detection signal is 
generated based on the result of comparison. so 
[0107] When the error is detected, a start code hav- 
ing a particular pattern is searched (step S21). In the 
MPEG standard, the start code includes a slice start 
code, a picture start code, a GOP start code or a 
sequence start code for indicating starting of a layer, or ss 
a sequence error code. 

[01 08] When the start code is detected through the 
search process, a determination is made as to whether 



or not the detected start code is effective for correct 
return (step S22). For example, a sequence error code 
which is a start code is not effective for the correct 
return (return to the steady state). Therefore, search for 
another start code is continued. 
[0109] When a start code effective for correct return 
is detected, a header following this start code is ana- 
lyzed (step S23). At this time, header Information 
included in the first segment following the start code is 
analyzed. Through this header analysis, the segment 
which must return to the normal state (steady state) is 
Identified. As shown In Fig. 1 1 , a header 1400 (including 
all headers up to a macro block header preceding 
macro blocks of the segment) stores resynchronization 
segment address information 1402 indcating the posi- 
tion on the display screen of the segment (macro block) 
at which return is matte to the normal state in error gen- 
eration. In the MPEG standard, for example, the resyn- 
chronization segment address information 1402 
corresponds to a slice vertical position and macro block 
address increment included in the slice header. A resyn- 
chronization segment address is Identified by analyzing 
the header 1400, whereby the segment which should 
return from the unsteady state to the steady state can 
be identified. 

[0110] When the valid start code is a sequence 
start code, a GOP start code or a picture start code in 
the MPEG standard, for example, the segment which 
should return to the steady state is the first segment of 
the picture. 

[0111] When the detected start code is a slice start 
code, return to the steady state can be started from the 
first segment of the slice layer since the slice layer is 
provided for preventing error propagation. The header 
of the slice layer Includes information indicating the 
position on the screen as described above, and the 
Information indicating the position on the screen is uti- 
lized as the resynchronization address. 
[0112] After the header information is analyzed, 
variable length decoding processing of the data of the 
macro block following the header is waited until pre- 
scribed conditions are established. 
[0113] Namely, a determination Is made as to 
whether or not the segment to be subsequently proc- 
essed in the picture decoding circuit corresponds to the 
macro block address obtained in the header analysis 
carried out at the step S23 (step S24). 
[0114] In the search for the start code, the bit 
stream which Is supplied to the picture decoding circuit 
is employed for the start code search, and no decoding 
processing of macro block data included in the bit 
stream is carried out On the other hand, the picture 
decoding circuit outputs picture data subjected to the 
error concealment processing which is described later 
in detail every processing section. For example, it is 
possible to recognize the address (position on the 
screen) of the segment processed in each processing 
section by counting the MB synchronizing signal 
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MBSYNC defining each processing section in the con- 
trol unit for example. Therefore, it is possible to discrim- 
inate whether or not a segment to be processed in the 
next processing section corresponds to the macro block 
address obtained in the header analysis in the control 5 
unit When the macro block address of the segment to 
be subsequently processed matches with the macro 
block address obtained by the header analysis, return is 
made to the normal operation from the next processing 
section under control by the control unit (step S25). 10 
[0115] Also in the return from the unsteady state to 
the steady state, the header information is analyzed in 
advance and the decoding processing of the block data 
Is started in accordance with the MB synchronizing sig- 
nal MBSYNC, whereby no reduction of the utilization 75 
efficiency is brought In the respective operational proc- 
essors of the picture decoding circuit. 
[0116] In the error development, reading of the pre- 
dictive picture data in each processing section may be 
stopped so that this period is utilized for data reading 20 
from the rate buffer. This is because the pixel data of the 
macro block can be replaced by average value data of 
pixel data of a macro block in a same common picture in 
error development, as described later in detail. Thus, ft 
is possible to search for the necessary start code at a 25 
highspeed. 

[0117] Rg. 1 2 schematicaJly illustrates the structure 
of a part related to the processing operation of error 
detection and the return in the picture decoding circuit 
This figure shows only the variable length decoder 1 21 2 so 
and the control unit 1226. The variable length decoder 
and the control unit are denoted by the same reference 
numerals as those of the variable length decoder and 
the control unit shown in Fig. 32. This is for indicating 
that the functions of picture decoding processing ftseff as 
are identical between the inventive and conventional 
units, but the structures are different from the conven- 
tional components as described above. 
[0118] The control unit 1226 supplies a start signal 
tACT for starting picture decoding processing and the 40 
MB synchronizing signal MBSYNC to the variable 
length decoder 1212. The variable length decoder 1212 
outputs to the control unit 1226 an error detection skpal 
<>ER, a valid start code (start code effective for return to 
the normal operation) detection indication signal $SD 45 
and a processing unit decoding completion indication 
signal <frCPL indicating that the information of the 
header of the segment is entirely analyzed. The opera- 
tion of the structure shown in Rg. 12 is now briefly 
described with reference to Rg. 13 which is an opera- so 
tion sequence diagram thereof. 
[0119] The control unit 1226 asserts the MB syn- 
chronizing signal MBSYNC onto the variable length 
decoder 1212. The variable length decoder 1212 
decodes the block data In synchronization with the ss 
assertion of the MB synchronizing signal MBSYNC, and 
outputs fixed length DCT coefficient data. After comple- 
tion of the decoding of the block data, information of the 



header of the next segment is analyzed. When analysis 
of the header information is entirely completed, the var- 
iable length decoder 1212 asserts the processing unit 
decoding completion indication signal <>CPL onto the 
control unit 1226. When the processing unit decoding 
completion indication signal $CPL is asserted, the con- 
trol unit 1226 asserts the MB synchronizing signal 
MBSYNC again onto the variable length decoder 1212 
after prescribed conditions are satisfied. In response to 
this, decoding processing of the block data Is executed. 
When an error is detected in the decoding procedure, 
the variable length decoder 1212 asserts the error 
detection indication signal <pER. In response to the 
assertion of the error detection indication signal <>ER, 
the control unit 1226 enters an error state. In this error 
state, error concealment processing described later is 
executed. The variable length decoder 1212 searches 
for a start code In response to the assertion of the error 
detection indication signal $EFL When a valid start code 
is detected, the variable length decoder 1212 asserts 
the start code detection ingestion signal +SD. When the 
start code Is detected, the variable length decoder 1212 
analyzes the information of the header part of the seg- 
ment following the start code, and asserts the process- 
ing unit decoding completion indication signal +CPL at 
the point of time when the analysis is completed, onto 
the control unit 1226. The control unit 1226 determines 
whether or not the segment to be executed in the next 
processing section is that whose header information is 
analyzed in accordance with the analyzed header infor- 
mation and the start code information, and asserts the 
MB synchronizing signal MBSYNC in response to the 
assertion of the processing unit decoding completion 
indication signal 4CPL if the segnent is to be executed 
in the next processing section. In the sequence shown 
in Rg. 13, therefore, the process returns to the steady 
state (normal state) from the processing section follow- 
ing that causing the error. 

[0120] Rg. 14 illustrates another operation 
sequence of the picture decodng circuit in error detec- 
tion. Referring to Rg. 14, an operation sequence identi- 
cal to that shown in Rg. 13 is executed after the error 
detection indication signal <>ER is asserted in error 
detection until the processing unit decoding completion 
indication signal $CPL is asserted. 
[0121] Upon assertion of the processing unit 
decoding completion indication signal +CPL, the control 
unit 1226 determines a time when the segment of the 
analyzed header must be processed from the analyzed 
header information (detection of the macro block 
address). When the analyzed segment is not to be exe- 
cuted in the next processing section, the control unit 
1226 asserts the MB synchronizing signal MBSYNC on 
conditions of assertion of the processing unit decoding 
completion indication signal <frCPU a lapse of a pre- 
scribed time (see Rg. 9) from the precedent MB syn- 
chronizing signal MBSYNC and vacancy (nonuse) of 
the DRAM port In the error time, the processing of the 
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block data of the analyzed segment is brought into a 
standby state. Until the processing section for the seg- 
ment which is analyzed and brought into the standby 
state is reached, the MB synchronizing signal MBSYNC 
is asserted every lapse of the prescribed time on the 5 
condition of vacancy of the DRAM port The vacancy of 
the DRAM port is made one of conditions In the error 
state since it is necessary to write decoded data from 
the picture decoding circuit in the DRAM port In this 
error state, the processing unit decoding completion 10 
indication signal <^CPL may be maintained in an 
asserted state. Namely, the processing unit decoding 
completion indication signal 4CPL may be reset by 
assertion of the MB synchronizing signal MBSYNC 
when the block data are to be processed in the next 1S 
processing section. 

[01221 When the processing section for processing 
the segment in the standby state Is reached, the picture 
decoding circuit enters the normal state in accordance 
with assertion of the MB synchronizing signal MBSYNC, 20 
to decode the block data of the segment in the standby 
state. 

[0123] When a processing section for an actual 
decoding is detected from the ^synchronization seg- 
ment address obtained at the time of the header anaiy- 25 
sis in the error state for return to the normal state, the 
following method can be employed: A counter which is 
reset In synchronization with a picture synchronizing 
signal (e.g., a vertical synchronizing signal VSYNC) 
indicating starting of a picture is employed to count the ao 
MB synchronizing signal MBSYNC, and the macro 
block address (position on the screen) of each process- 
ing section Is monitored in accordance with the count 
value. When an address subsequent to the monitored 
macro block address Is equal to the resynchronization as 
address, the block data of the segment at the standby 
state must be processed In the next processing section. 
Since the header Information is entirely analyzed before 
assertion of the MB synchronizing signal MBSYNC, this 
determination processing can be reliably carried out in a 40 
processing section which is precedent to that for actu- 
ally executing the decoding processing. 
[0124] Also In such error development, the header 
information is entirely analyzed and the subsequent 
processing Is brought into a standby state and process- 45 
ing of the standby state block data is executed in syn- 
chronization with the MB synchronizing signal MBSYNC 
when the processing must be carried out The block 
data to be processed are immediately supplied to the 
variable length decoder 1212 in synchronization with so 
the MB synchronizing signal MBSYNC also in return 
from the error state to the normal state, and hence the 
processing can be executed at a high speed. In the 
operation sequence shown in Fig. 14, no block data are 
newly supplied to the picture decoding circuit during the 55 
period of the error state. The error concealment 
processing described later in detail Is executed in this 
processing section. 



[0125] Fig. 15 specifically illustrates the Internal 
structure of the variable length decoder 1212 shown In 
Rg. 12. Referring to Fig. 1 5, the variable length decoder 
1212 includes a bit stream feeder 1 receiving the bit 
stream which is read from the rate buffer through a 
buffer memory (not shown) and supplying bit stream 
data from the head (first) bit of a variable length symbol, 
a start code detector 2 receiving the data from the bit 
stream feeder 1 and detecting the start code, a header 
analysis part 3 receiving the bit stream data from the bit 
stream feeder 1 and analyzing the header information, a 
block data decoder 4 decoding the block data included 
in the bit stream data from the bit stream feeder 1 and 
generating fixed length quantized DCT coefficient data, 
an error detection part 5 detecting occurrence of an 
error in response to an error detection signal from the 
start code detection part 2, the header analysis part 3 
and the block data decoder 4, and a control part 6 con- 
trolling the operation of the variable length decoder 
1212. 

[0126] The control part 6 receives a start request 
signal *ACT (this signal is described later in relation to 
an operation in resetting) and the MB synchronizing sig- 
nal MBSYNC, and outputs an error detection indication 
signal 4ER, a processing unit decoding completion indi- 
cation signal 4CPL and a start code detection Indication 
signal $SD. This control part 6 receives a detected start 
code from the start code detection part 2, and asserts 
the start code detection indication signal <>SD when the 
start code is effective for return to the steady state. The 
control part 6 also receives a header information analy- 
sis completion indication signal (detected by end bit 
detection of the header) from the header analysts part 3 
and asserts the processing unit decoding completion 
Indication signal <>CPL The control part 6 asserts the 
error detection indication signal +ER in response to the 
error detection signal from the error detection part 5. 
[0127] The control part 6 further receives the start 
code from the start code detection part 2, information 
indicating a bit lengths of analyzed variable length code 
from the header analysis part 3, and bit length informa- 
tion of a decoded variable length code from the block 
data decoder 4, deletes the processed (detected, ana- 
lyzed or decoded) variable length code in the bit stream 
feeder 1, detects a next head bit of a variable length 
code and supplies the next variable length code from 
the head (first) bit to the header analysis part 3 or the 
block data decoder 4 from the feeder 1 . The bit stream 
feeder 1 regularly outputs data bits successively from 
the most significant bit of a variable length code under 
the control of control part 6. The start code detector 2 
constantly monitors the bit data from the bit stream 
feeder 1, to detect whether or not the start code is 
included. 

[0128] The header analysis part 3 analyzes variable 
length code words (header information) supplied from 
the bit stream feeder 1 1mmediately subsequently to the 
completion of the decoding operation of the block data 
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decoder 4 under control by the control part 6 (this con- 
trol path is not shown). The block data decoder 4 Is acti- 
vated in synchronization with the MB synchronizing 
signal MBSYNC under control by the control part 6, and 
decodes the variable length codes supplied from the bit 5 
stream feeder 1. 

[0129] The header analysis part 3 extracts informa- 
tion such as motion vectors, a processing method (pre- 
diction method) for the macro blocks and the like as well 
as return (resynchronization) segment address Informa- to 
tion in error generation for supplying to the control unit 
The block data decoder 4 outputs a fixed length quanti- 
zation index to the next stage inverse quantizer. 
[0130] The header analysis part 3 is described as 
constantly analyzing variable length codes. However, is 
the sequence header, the GOP header and the picture 
header are fixed length data, which are subjected to 
fixed length decoding. Whether the header analysis part 
3 carries out analysis of fixed length codes or analysis 
of variable length codes is decided by the control part 6 20 
in accordance with the start code detected in the start 
code detection part 2. The control part 6 instructs the 
header analysis part 3 about which analysis operation 
should be carried out in accordance with the detected 
start coda Alternatively, such a structure that the 25 
header analysis part 3 itself determines which operation 
is carried out along a syntax may be employed. Further, 
the start code detection part 2 is described as con- 
stantly searching for the start code. However, the start 
code detector 2 may alternatively be so structured that 30 
its detecting operation is stopped in operations of the »• 
header analysis part 3 and the block data decoder 4. 
[0131] Fig. 16 specifically illustrates the internal 
structure of the control unit 1226 shown in Fig. 12. 
Referring to Fig. 16, the control unit 1226 Includes an as 
initialization control circuit 14 outputting a start indica- 
tion signal $ACT for the variable length decoder in 
response to a reset request indication signal <>RRQ, a 
state monitor 15 monitoring the progress state of the 
processing of the variable length decoder in accordance 40 
with the error detection indication signal <>ER and the 
start code detection indication signal $SD from the vari- 
able length decoder, and an operation driving circuit 11 
receiving the starting indication signal <>ACT from the 
initialization control circuit 14, the output signal from the 45 
state monitor 1 5, a picture synchronizing signal PSYNC 
indicating starting of a picture, a processing unit decod- 
ing completion indication signal ^CPL supplied from the 
variable length decoder and header information (block 
specifying information) and supplying the MB synchro- so 
nizing signal MBSYNC to respective pipeline stages of 
computing units of the decoding circuit 
[0132] The initialization control circuit 14 asserts 
the starting indication signal {ACT for supplying to the 
variable length decoder when the reset request signal ss 
<frRRQ requesting resetting of a decoding operation of 
picture data is asserted. This reset request signal <>RRQ 
may be a decoding processing start indication signal for 



instructing the starting of decoding the picture data, or a 
reset request Indication signal resulting from interrup- 
tion of an external control unit Further, the reset 
request signal <>RRQ may be generated when an error 
state is caused in continuation for a prescribed time 
duration or the error detection indication signal is suc- 
cessively asserted by a prescribed number of times in a 
prescribed time. 

[0133] The state monitor 15 informs the operation 
driving circuit 11 of the fact that an error occurs in the 
decoding process of the variable length decoder in 
response to assertion of the error detection Indication 
signal $ER, and of the fact that the variable length 
decoder enters a preparation stage for return to the nor- 
mal state upon assertion of the start code detection 
indication signal $SH 

[0134] The operation driving circuit 1 1 starts clock- 
ing of a timer 16 upon assertion of the MB synchroniz- 
ing signal MBSYNC. The timer 16 carries out its 
counting operation, and supplies a time-out signal to the 
operation driving circuit 11 upon reaching a set time. 
This timer 16 may be so structured that the operation 
driving circuit 11 changes the set time In accordance 
with block attribute Information (header information) 
supplied from the variable length decoder (see Fig. 8). 
In a normal state, the operation driving circuit 1 1 asserts 
the MB synchronizing signal MBSYNC when the 
processing unit decoding completion indication signal 
4CPL is asserted, the time-out signal from the timer 16 
is asserted and a signal indicating a vacant state (read- 
ing from the rate buffer is completed) of a DRAM port is 
received from a bus access controller 12. 
[0135] Upon error generation, the operation driving 
circuit 1 1 carries out the following operation in accord- 
ance with a signal outputted from the state monitor 15: 
The operation driving circuit 1 1 includes a counter (not 
shown) which is reset in response to the picture syn- 
chronizing signal PSNC and counts up every assertion 
of the MB synchronizing signal MBSYNC. The count 
value of this counter indicates the position on the screen 
(macro block address) of the segment processed in the 
variable length decoder. When it is informed from the 
state monitor 1 5 of the fact that a start code effective for 
normal return is detected in accordance with the start 
code detection Indication signal <>SD, the operation driv- 
ing circuit 1 1 extracts a resynchronization address from 
the block attribute Information which is supplied follow- 
ing the start code detection indication signal $SD. It 
compares the resynchronization address with the count 
value of the counter, and determines whether or not it is 
possible to return to the normal state from the next 
processing section. If it is possible to return to the nor- 
mal state at the next processing section, the operation 
driving circuit 11 asserts the MB synchronizing signal 
MBSYNC in response to assertion of the processing 
unit decoding completion indication signal 4CPL which 
is supplied following the start code detection indication 
signal QSD, time out indication of the timer 1 6 and a rate 
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buffer reading completion (DRAM port empty) indication 
signal from the bus access controller 12. The respective 
operational processors following the variable length 
decoder (block data decoder of Rg. 15) operate in 
response to the MB synchronizing signal MBSYNC. 5 
[0138] When the next processing section is not yet 
that in which return to the normal state should be made, 
on the other hand, the operation driving circuit 1 1 out- 
puts the MB synchronizing signal MBSYNC in accord- 
ance with the time-out signal outputted from the timer 10 
1 6 and the signal of the bus access controller 12 indicat- 
ing nonuse of the DRAM port In this error state (the 
state where the next processing section is not that in 
which return to the normal state should be made), the 
MB synchronizing signal MBSYNC may be supplied to is 
the pipeline stages of the respective operational proces- 
sors excluding the variable length decoder. Alterna- 
tively, the MB synchronizing signal MBSYNC may be 
supplied to the respective operational processors of the 
pipeline stages including the variable length decoder 20 
(block data decoder) while a normal return inhtoition sig- 
nal is asserted from the operation driving circuit 1 1 to be 
supplied to the variable length decoder simultaneously 
at this time so that a variable length decoding operation 
by the variable length decoder can be inherited. Also in 25 
the error state, the picture decoding circuit outputs pic- 
ture data (the error conceaknent processing described 
later is carried out). 

[0137] When a segjnent in a standby state is to be 
executed in the next processing section, the operation x 
driving circuit 1 1 asserts the MB synchronizing signal 
MBSYNC In accordance with the time-out signal output- 
ted from the timer 16 and the signal indicating the empty 
state of the DRAM port outputted by the bus access 
controller 12. Thus, the operation driving circuit 11 as 
returns to the normal state, and stops the operation of 
comparing the count value of the counter with the resyn- 
ch ionization segment address, In this normal state, the 
operational processors following the variable length 
decoder (block data decoder) operate in accordance 40 
with the MB synchronizing signal MBSYNC from the 
operation driving circuit 11, to execute prescribed nor- 
mal processing respectively 

[0138] The bus access controller 12 controls an 
access operation to the DRAM port under control by the 45 
operation driving circuit 11. Namely, it executes port 
control of the FIFO interface 1210 and the memory 
interface 1224 shown in Fig. 32 successively in a pre- 
scribed order. Namely, the bus access controller 12 first 
writes completely decoded picture data from the pixel so 
recorrfigurator 1220 in the external memory (DRAM) 
1230 through the memory interface 1224 in synchroni- 
zation with the MB synchronizing signal MBSYNC from 
the operation driving circuit 1 1 (in a normal operation). 
[0139] After completion of this write operation, the ss 
bus access controller 12 executes writing of the bit 
stream from the FIFO interface 1210 in the external 
memory (DRAM) through the memory interface 1224 



(writing in the rate buffer), rearing of display picture 
data from the external memory (DRAM) 1230 in the 
pixel bus interface 1222 through the memory interface 
1224, transfer of predictive picture data from the exter- 
nal memory (DRAM) 1230 through the memory inter- 
face 1224, and transfer of data from the external 
memory (DRAM) 1230 into the variable length decoder 
through the FIFO Interface 1210 and the memory inter- 
face 1224 (transfer to a buffer memory (not shown)) 
(reading of the rate buffer). During this time, the bus 
access controller 12 executes refreshing of the external 
memory PRAM) 1230 at prescribed intervals, and 
inhibits access to the external memory during this 
refreshing. In the error state, the bus access controller 
12 may utilize the period of reading predictive picture 
data as a period of reading data from the rate buffer in 
response to the error state indication signal from the 
operation driving circuit 11. Further, a completion time 
of reading the predictive picture data may be decided in 
accordance with the block attribute information from the 
operation driving circuit 11. 

[0140] An error concealment control circuit 1 3 con- 
trols the error concealment processing described later 
In detail. This error concealment control circuit 13 Is 
started in response to the error detection indication sig- 
nal fER from the state monitor 15 to instruct the error 
concealment processing (signal $ERR) to the scan con- 
version part or to the pixel recorrfigurator and the scan 
conversion part, and instructs completion of this error 
concealment processing in response to a normal state 
return indication from the operation driving circuit 11. 
[0141] According to the embodiment of the present 
invention, as hereinabove described, the start code 
which is effective for return from the error state to the 
steady (normal) state is detected In error generation, 
then analysis of the header information of the segment 
is executed and processing of the block data of the seg- 
ment is delayed up to arrival of the processing section 
for actual processing, whereby return to the normal 
state can be carried out also in error development with- 
out reducing the utilization efficiency of the operational 
processors. 

Error Concealment Processing 1 ; 

[Q142] Rg. 1 7 schematically illustrates the structure 
of the pixel recorrfigurator 1220 of the picture decoding 
circuit according to the present invention. Referring to 
Fig. 17, the pixel recorrfigurator 1220 includes a buffer 
memory 20 temporarily storing data supplied through 
the memory interface 1224, a predictive picture filter 
part 21 forming predictive pictures through the picture 
data stored in the buffer memory 20, a computing ele- 
ment 22 illustrated as an adder for adding up data from 
the inverse discrete cosine transformation part (IDCT) 
121 8 and an output signal from the predictive picture fil- 
ter part 21 and carrying out DPCM decoding, a selec- 
tion circuit 23 selecting one of the data outputted from 
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the IDCT 1218, data outputted from the computing ele- 
ment 22 and the pixel data from the predictive picture fil- 
ter part 21 , and a buffer memory 24 temporarily storing 
output data of the selection circuit 23. The storage data 
of the buffer memory 24 are stored in the external mem- 5 
ory (DRAM) as decoded pixel data through the memory 
interface 1224. Macro block types of B pictures include 
(1) Intra-frame/1 ntra-fie Id prediction employing neither 
one of forward prediction and reverse (backward) pre- 
diction, (2) forward prediction in which prediction is to 
made based on past reproduced pictures, (3) reverse 
prediction in which prediction is made based on the 
future pictures, and (4) Interpolation prediction employ- 
ing both of past and future pictures. 
[0143] The predictive picture filter part 21 carries 15 
out prescribed processing in accordance with the macro 
block type, and forms predictive pictures. The pixel 
reconfigurator 1 220 further includes a control part 25 for 
controlling the operation of pixel reconfiguration. The 
control part 25 receives header information supplied 20 
from the variable length decoding part, the MB synchro- 
nizing signal MBSYNC and the error detection indica- 
tion signal 4ERR from the control unft (see Fig. 16), and 
a bus employment allowing signal from the control unit 
(bus access controller). The control part 25 decides fil- 25 
ter processing which is executed in the predictive pic- 
ture filter part 21 in accordance with the macro block 
type included in the header information. Further, the 
control part 25 controls data writing and data reading In 
and from the buffer memories 20 and 24 in synchroniza- 30 
tion with the MB synchronizing signal MBSYNC. 
[0144] As to picture data which are loaded in the 
buffer memory 20 through the memory interface 1224, 
addresses are generated in accordance with motion 
vector information formed through the result of analysis as 
of the header analysis part in the variable length 
decoder and necessary picture data (reference seg- 
ment data) is read from the external memory PRAM). 
In error development, the motion vector Information is 
formed on the basis of transmitted motion vector infer- 40 
mation. As described later, this motion vector may be 
set at zero in the case of an error generation. Alterna- 
tively, motion vector indicating a macro block which is 
precedent by one fine may be employed in the case of 
an error generation. Namely, macro block data of a cor- 45 
responding portion in the predictive pictures) are read 
in error generation. 

[0145] Under control by the control part 25, the 
selection circuit 23 selects the data from the IDCT 1 21 8 
when the processed macro block is an intra-preticted so 
macro block (I pictures and intra-predicted B pictures), 
selects the data outputted from the computing element 
22 with respect to a p reaction encoded macro block 
other than intra prediction, and selects the output data 
from the predictive picture filter part 21 in error process- ss 
ing. An error countermeasure operation in the case of 
employing the pixel reconfigurator shown in Fig. 17 is 
now described. 



[0146] Fig. 18 is an operation sequence diagram 
representing the error countermeasure operation of the 
picture decotfing circuit in error processing. As shown in 
Fig. 18, the picture decoding circuit is formed into four 
pipeline stages in units of segments (macro blocks), 
similarly to the aforementioned embodiment Consider 
that an error occurs in a decoding process for block data 
of a segment MB#1 1 . The error detection indication sig- 
nal $ER tyERR) is asserted in this state, while the vari- 
able length decoder and the control unit execute the 
aforementioned operations upon generation of an error. 
In the processing section during which this error occurs, 
the pixel reconfigurator 1220 shown in Fig. 17 carries 
out a pixel decoding operation so that restored pixel 
data are stored in the buffer memory 24. When a next 
processing section is started, predictive picture data for 
error concealment of a part corresponding to a macro 
block MB#12 are stored in the buffer memory 22 
through the memory interface 1224. The predictive pic- 
ture filter part 21 forms predictive picture data for the 
macro block MB#1 1. On the other hand, the IDCT 1218 
forms inverse-quantized data of block data of a macro 
block MB#10, so that pixel-restored data are formed in 
accordance with the macro block type thereof through 
the selection circuit 23 and successively written in the 
buffer memory 24. In the buffer memory 24, on the other 
hand, previously stored decoded pixel data of a macro 
block MB#9 are written in the DRAM through the mem- 
ory interface 1224. In the buffer memories 20 and 24, 
new data are written after storage data thereof are 
entirely read out 

[0147] Thereafter pipeline processing is succes- 
sively executed so that data of corresponding macro 
blocks of the predictive pictures are successively read 
from the external memory (DRAM) and picture data are 
generated in this error state (slanted areas in Fig. 18). 
[0148] Predictive picture pixel data read in the 
processing section for the macro block MB#12 are 
selected by the selection circuit 23. Thus, correspond- 
ing pixel data of the predictive pictures are successively 
stored In the buffer memory 24. The predictive picture 
fitter part 21 carries out filter processing in accordance 
with a predetermined rule in error detection. 
[0149] Therefore, pixel data subjected to error 
countermeasures, i.e., pixel data of predictive pictures, 
are successively stored in the DRAM from a processing 
section for processing a macro block MB#15. 
[0150] When the error state is ended in a process- 
ing section for a macro block MB#16, processing of a 
macro block MB#17 is executed from the next process- 
ing section, in this case, the selector 23 selects either 
data outputted from the IDCT 1218 or data outputted 
from the computing element 22 in accordance with 
header information when the processing of the block 
data of the macro block MB#1 7 reaches the third pipe- 
line stage. 

[0151] Due to the aforementioned series of opera- 
tions, pixel data which are missed by an error can be 
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replaced by pixel data of predictive pictures in an error 
state, thereby suppressing picture quality deterioration 
of decoded picture images caused fay mixing of an error 
bit (see Fig. 1 9). Namely; it is possible to suppress dete- 
rioration in quality of decoded images in the macro 5 
bioclcs MB#12 to MB#16 in the error state, as shown in 
Fig. 19. 

Error Concealment Processing 2: 

10 

[0152] Fig. 20 illustrates the structure of a pixel 
reconfjgurator 1220 for Implementing second error con- 
cealment processing according to the present invention. 
In the structure of the pixel recorrftgurator shown in Fig, 
20, a control part 35 sets a selection circuit 33 in a state is 
selecting an output signal of an IDCT 1218 in response 
to header information, an MB synchronizing signal 
MBSYNC, an output signal of a bus access controller 
and an error concealment control circuit included in the 
control unit of Fig. 6 when an error is generated. Other 20 
structures are identical to those shown in Fig. 17, and 
corresponding parts are denoted by the same reference 
numerals. In a normal state, the control part 35 makes a 
computing element 22 process (DPCM-decode) pixel 
data from a predictive picture filter part 21 and pixel data 2s 
outputted from the IDCT 1 21 8, and thereafter selects an 
output signal from the IDCT 1218 or the computing ele- 
ment 22 through the selector 33 in accordance wfth the 
type of this picture for writing into a buffer memory 24. In 
an error state, Le., in activation of a signal $ERR, the 30 
control part 35 controls the selection circuit 33 and sets 
the same in a state selecting the data outputted from the 
IDCT 1218 regardless of the picture type. 
[0153] The IDCT 121 8 is supplied with data output- 
ted from a scan conversion part 121 6 whose structure is as 
hereafter described in detail. As hereafter described in 
detail. In an error state, the scan conversion part 1216 
supplies the IDCT 1218 with decoded macro block data 
precedent by one line (data before IDCT processing) in 
the same picture or a predetermined fixed value (when 40 
no macro block precedent by one line is present) from a 
processing section following that having the error 
caused. 

[0154] Fig. 21 illustrates the internal structure of the 
scan conversion part 1216 shown in Fig. 20 In detail. 4S 
Referring to Fig. 21, the scan conversion part 1216 
Includes a buffer memory 40 successively storing 
inverse-quantized DCT coefficient data outputted from 
an inverse quantizer and then outputting the stored data 
in the raster scan order, a read/write control circuit 41 so 
controlling data writing and data reading of the buffer 
memory 40, an averaging circuit 42 obtaining the aver- 
age value of DCT coefficients read from the buffer mem- 
ory 40, a memory 43 storing average data of macro 
blocks by one line, for example, among average value 55 
data outputted from the averaging circuit 42 in a FIFO 
fashion, a read/write control circuit 44 controlling data 
writing and reading of the memory 43, and a selection 



circuit 45 selecting either DCT coefficient data outputted 
from the buffer memory 40 or data from the memory 43 
for outputting to the IDCT 1218 under control by the 
read/write control circuit 44. 

[0155] The read/write control circuit 41 stores in 
buffer memory 41 inverse quantized DCT coefficient 
data which are supplied from the inverse quantizer at 
the precedent stage in synchronization with the MB syn- 
chronizing signal MBSYNC. This read/write control cir- 
cuit 41 simply has a function of converting read and 
write addresses for the buffer memory 40, and adjusts 
the addresses to re-arrange the DCT coefficients, which 
have been scanned in a zigzag scan fashion, into the 
raster scan order for outputting. The address generation 
may be so done that either read or write addresses are 
generated in a predetermined sequence while the other 
addresses are successively incremented so that zig- 
zag-scanned pixel data are re-arranged in the raster 
scan order. The zigzag scan converter 1216 may not be 
particularly Included in a pipeline stage, since it func- 
tions as a buffer circuit by the buffer memory 40. There- 
fore, the reaoTwrite control circuit 41 may be formed to 
generate addresses In synchronization with an input 
synchronizing signal indicating starting of the DCT coef- 
ficient data. 

[0156] The averaging circuit 42 obtains the average 
value of the DCT coefficient data which are read from 
the buffer memory 40. At this time, the average value 
may be obtained by arithmetic mean values (all DC and 
AC coefficients) of all DCT coefficient data. In a block of 
8 by 8 pixels, however, a DC coefficient indicates the 
average value of pixel data of the block. Therefore, the 
averaging circuit 42 may obtain the average value of the 
DCT coefficient data of four blocks for a luminance sig- 
nal while utilizing the DC coefficient as the average 
value for a chrominance signal, with respect to one 
macro block. 

[0157] The memory 43 stores average value data of 
DCT coefficients with respect to respective macro 
blocks for one line, for example, in the FIFO fashion. 
Operations of the scan conversion part and the pixel 
reconfigurator shown in Figs. 20 and 21 are now 
described with reference to Fig. 22, which is an opera- 
tion sequence diagram. 

[0158] Fig. 22 illustrates operations in the case 
where an error is caused in decoding of block data of a 
macro block MB#11 and return Is made to a normal 
state from a macro block MB#1 7, for example. 
[0159] When an error detection indication signal 
4ER is asserted, an error indication signal $ERR from 
the error concealment control circuit is asserted in 
response (no <>ERR is shown in Fig. 22). In response to 
the assertion of the error detection indication signal 
+ERR, the read/write control Circuit 44 shown in Fig. 21 
inhibits writing of average value data to the memory 43. 
Namely, storage of an average value data of DCT coef- 
ficient data calculated is inhibited in the case of error 
detection. Therefore, the memory 43 stores the average 



20 



39 



EP 1 085 465 A2 



40 



value of DCT coefficients of one-fine worthy macro 
blocks up to a macro block MB#9. No average value 
data of DCT coefficients of a macro block MB#10 is 
stored In the memory 43. Average value data of DCT 
coefficients of a macro block which is precedent to the 5 
macro block MB#10 just by one line is stored in a head 
address position of the memory 43. In a processing sec- 
tion having this error caused, pixel restoration process- 
ing for the macro block MB#9 is executed. Namely, the 
selection circuit 33 shown in Fig. 20 selects either an 10 
output signal of the computing element 22 or data out- 
putted from the IDCT 1218 and supplies the selected 
one to the buffer memory 24, In accordance with an out- 
put signal from the control part 35. 
[0160] In a processing section subsequent to that is 
having the error caused, the reaoYwrite control circuit 44 
shown in Fig. 21 reads average value data of DCT coef- 
ficients of a macro block, which is precedent by one line, 
stored in the head position from the memory 43 in 
response to the error indication signal $ERR, and sup- 20 
plies the read average data to the IDCT 1218 through 
the selection circuit 45. The memory 43 may store one 
average value data for luminance blocks of the macro 
block, or average value data for respective luminance 
signal blocks (since the IDCT 1218 executes inverse 2s 
discrete cosine transformation processing in units of 8 
by 8 pixels). 

[0161] The selection circuit 33 shown in Fig. 20 is 
set in a state of selecting data outputted from the IDCT 
1218, under control by the control part 35. In the so 
processing section subsequent to that having the error 
caused, therefore, pixel restoration (DPCM decoding) is 
executed in accordance with the pixel data of the macro 
block which is precedent by one line. As shown in Fig. 
22, therefore, the error concealment processing can be as 
executed from the macro block which is ahead of that 
having the error caused while the error concealment 
processing can be executed also for the macro block 
causing the error, whereby picture quality deterioration 
caused by mixture of an error bit can be further sup- 40 
pressed. Data of different macro blocks are succes- 
sively read from the memory 43 every processing 
section in synchronization with the MB synchronizing 
signal MBSYNC. 

[0162] When return is made from the error state to 45 
the normal state, the data from the memory 43 are 
selected and supplied to the IDCT 1218 in the process- 
ing section if the error indication signal ^ERR is deas- 
serted, average value data from the averaging circuit 42 
are written in the memory 43 in the next processing sec- so 
tion, and the selection circuit 45 is set in a state of 
selecting the output of the buffer memory 40 in a 
processing section subsequent to the next one. 
[0163] The memory 43 stores the data in the FIFO 
fashion, and hence the state of successively storing the 55 
pixel block data for one line is maintained also when the 
average value of block data of the macro block MB#17 
is newly written in the memory 43 in the FIFO fashion. 



[0164] In the return to the normal state, data may be 
written In the buffer memory 40 in synchronization with 
an input synchronizing signal indicating starting of block 
data supplied from the precedent stage inverse quan- 
tizer under control by the read/write control circuit 41. 
Alternatively, a normal state return indication signal may 
be supplied to the read/Write control circuit 41 from the 
control unit so that the writing Is performed from the 
processing section supplied with the norma! state return 
indication signal (when the scan conversion part forms 
the final substages of the first pipeline stage including 
multiple substages (the first pipeline stage is up to data 
writing in the buffer 40)). Alternatively, the data may be 
written in the buffer memory 40 under control by the 
read/write control circuit 41 from a processing section 
subsequent to the processing section of return to the 
normal state (when the scan conversion part is included 
In the third pipeline stage). Alternatively, the scan con- 
version part 1 21 6 may be arranged to form a part of the 
second pipeline stage. 

[01 65] When the error is caused at the head of the 
picture, a predetermined fixed value is employed since 
no corresponding average value data is present While 
this structure is not shown, either average value data or 
fixed value data may be selected in accordance with 
address (position on the screen) information of the proc- 
essed macro block, as shown in the dotted line in Rg. 
21. 

[0166] Fig. 23 illustrates modes of the macro blocks 
which are subject to error-concealment process in the 
second error concealment processing shown in Figs. 20 
to 22. As shown in Rg. 23, the error concealment 
processing is executed through pixel data of a macro 
block which is ahead of the macro block MB#10, prece- 
dent to the macro block MB#1 1 having me error caused, 
by one One. Namely, the block data of the macro blocks 
MB#10 to MB#16 are replaced by pixel data of macro 
blocks MB#2 to MB#8 which are precedent by a single 
line in the same picture. 

[0167] In the above description, the error conceal- 
ment processing is carried out through the average 
value of the block data of the precedent macro blocks in 
error development A line memory storing pixel data of 
macro blocks for one line may be arranged in the pixel 
reconfigurator 1220 so that decoded pixel data of the 
macro blocks stored in this line memory are stored in 
the external memory (DRAM) through the buffer mem- 
ory 24 for replacing the respective pixel data with those 
of the macro block precedent by one line respectively in 
error development 

[0168] According to the structure of the embodi- 
ment of the present invention, as hereinabove 
described, the error concealment processing can be 
efficiently executed by effectively utilizing the pipeline 
stages of the picture decoding circuit Particularly when 
the error concealment processing is carried out through 
decoded data (variable length decoded data) in the 
same picture, the error concealment processing can be 
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executed from the macro block which is precedent In 
processing order to the segment (macro block) having 
the detected error, whereby further effective error con- 
ceafrnent processing can be carried out and picture 
quality deterioration caused by mixing of an error bit can 5 
be suppressed. 

Initialization Operation 1 ; Restarting (Return from Error) 

[0169] Rg. 24 Is a flow chart showing an initializa- 
tion operation of the picture decoding circuit The initial- 
ization operation of the picture decoding circuit 
according to the present invention is now described 
[0170] Rrst, a determination is made as to whether 
or not a reset request is made (step S30). This reset 
request is made in restarting when break of display by 
interruption through an external control unit or an error 
state continues over a prescribed time (when a state of 
returning from an error state to the normal state fol- 
lowed by re-return to the error state Is continued). 
[0171] When a reset request (restart instruction) is 
made, the control unit 1226 (see Rg. 16) first deter- 
mines whether or not this picture decod ng circuit cur- 
rentty carries out decoding of picture data (step S31). if 
decoding of the picture data is currently earned out 
(when a pixel restoration operation is carried out includ- 
ing an operation in an error state), generation of the MB 
synchronizing signal MBSYNC from the next process- 
ing section is stopped (step S32). When generation of 
the MB synchronizing signal MBSYNC is stopped, the 
start signal 4ACT (R) is asserted and supplied to the 
variable length decoder (see Rg. 15). When no pixel 
restoration operation is carried out at the step S31, on 
the other hand, the step S32 is skipped and the start 
signal ^ACT (R) is asserted at a step S33. as 
[0172] The variable length decoder searches for a 
start code indicating starting of a picture in response to 
the assertion of the start signal *ACT (R). Namely, it 
searches for a sequence start code, a GOP start code 
or a picture start code. At this time, a slice start code is 40 
neglected because a new picture is searched When a 
start code indicating starting of a picture is detected, 
information of a header part following this start code is 
analyzed, and header information of a segment of a 
macro Week layer is analyzed (step S34). Establishment 45 
of prescribed conditions is waited in the state of having 
analyzed the header information (step S35). The pre- 
scribed conditions are that a sufficient quantity of bit 
stream is stored in the rate buffer and a vertical synchro- 
nizing signal supplied from the external display control so 
unit Is asserted. It is possible to discriminate whether or 
not a sufficient quantity of bit stream is stored in the rate 
buffer by detecting difference between write and read 
addresses of FIFO area of the external memory device 
(DRAM) through the bus access controller 12 shown in ss 
Fig. 16. 

[0173] When the prescribed conditions are estab- 
lished, the control unit asserts a picture synchronizing 



signal indicating the starting of the picture, resets a 
counter included in its interior for indicating a macro 
block address, asserts the MB synchronizing signal in 
synchronization with the picture synchronizing signal, 
and makes the picture decoding circuit execute a nor- 
mal operation (step S36). Due to the assertion of the 
MB synchronizing signal MBSYNC In synchronization 
with the picture synchronizing signal PSYNC, display 
picture data can be correctly read in synchronization 
with a vertical synchronizing signal, for example, sup- 
pried from the external control unit when the reset 
request is made and a new picture is displayed. Further, 
pixel decoding operations can be successively executed 
in parafle! with the picture display. 
[0174] The series of operations through the steps 
S30 to S33 are executed by the initialization control cir- 
cuit 14 shown in Fig. 16. 

Initialization Operation 2: Reset Operation 

[0175] Rg. 25 is a flow chart showing another Initial- 
ization operation of the picture decoding circuit This ini- 
tialization operation of the picture decoding circuit 
according to the present invention is now described. In 
this initialization operation, the user newly designates 
picture display. 

[0176] First, a determination is made as to whether 
or not a reset request (initialization instruction) is made 
(step S40). This reset request is generated from hard- 
ware or software (set of register values) in accordance 
with a picture display designation from the user. 
[0177] When the reset request is made to designate 
display of a new picture, a start signal $ACT (I) is 
asserted and supplied to the variable length decoder 
(see Fig. 15) since the picture decoding circuit carries 
out no picture data decoding operation at this time (step 
S41). 

[01 78] In response to the assertion of the start sig- 
nal 4ACT (I), the variable length decoder searches for a 
sequence start code. A GOP start code, a picture start 
code and a slice start code are neglected. When a 
sequence start code is detected and a start code indi- 
cating starting of a picture is then detected, information 
of a header part following the start code is analyzed and 
header information of a segment of a macro block layer 
is analyzed (step S42). In the state of having analyzed 
this header information, establishment of prescribed 
conditions is waited (step S43). The prescribed condi- 
tions are identical to those described with reference to 
the step S35 in Rg. 24. Namely, the prescribed condi- 
tions are that a sufficient quantity of bit stream is stored 
in the rate buffer and a vertical synchronizing signal 
supplied from the external display control unit is 
asserted. When the prescribed conditions are estab- 
lished, the control unit asserts a picture synchronizing 
signal indicating starting of a picture, resets a counter 
indicating a macro block address included in its interior, 
asserts an MB synchronizing signal in synchronization 
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with the picture synchronizing signal and makes the pic- 
ture decoding circuit carry out a normal operation (step 
S44). Upon user's reset request, the assertion of the 
MB synchronizing signal is made in synchronization 
with the assertion of the picture synchronizing signal, 5 
whereby display picture data can be correctly read in 
synchronization with the vertical synchronizing signal, 
for example, supplied from the external control unit in 
the case of displaying a picture of a new sequence, and 
pixel decoding operations can be successively executed w 
along the picture display. 

[0179] The series of processing operations are exe- 
cuted by the initialization control circuit 1 4 shown in Bg. 
16. The start signal $ACT is so indicated that the same 
signal is asserted in a reset request designating re is 
ing of display and in that designating initialization of dis- 
play However, these are different signals, and start 
codes to be searched In restarting and initialization are 
discriminated in response to the types of the start sig- 
nals +ACT, or $ACT (R) and $ACT (I). 20 
[0180] Fig. 26 illustrates exemplary operations of 
the picture decoding circuit in a reset operation. This fig- 
ure shows such a state that an initialization indication 
(reset indication) Instructing picture display is supplied 
from the exterior, for example (see Fig. 25). In this state, 2s 
no MB synchronization signal MBSYNC is asserted 
since the picture decoding circuit carries out no pixel 
decocfing operation. 

[0181] When a reset request signal <>RRQ is 
asserted, the start signal 4ACT (I) is outputted ao 
(asserted) from the initialization control circuit shown in 
Fig. 16. In response to the assertion of the start signal 
♦ACT (I), the variable length decoder searches for a 
start code indicating starting of a picture of a sequence 
layer. In this search operation, data are read from the as 
rate buffer under control by the control unit If no bit 
stream is yet stored in the rate buffer but the bit stream 
first arrives upon generation of the reset request signal 
tRRQ, the control unit directly supplies the bit stream 
supplied through the FIFO interface to the variable 40 
length decoder, to make the same search a start code. 
The variable length decoder analyzes the start code 
detected by the start code detector (see Fig. 15) in the 
control part 6, detects the picture start code indicating 
the starting of the picture subsequently to the detection 45 
of the sequence start code, and analyzes header infor- 
mation subsequent to the detected picture start coda In 
restarting, a start code in a layer above a macro block 
layer is searched and header information is analyzed 
after detection thereof. When the header information of so 
the segment of the macro block layer is completely ana- 
lyzed, the variable length decoder asserts a processing 
unit decoding completion indication signal 4CPL. In 
response to the assertion of the processing unit decod- 
ing completion indication signal 4CPL, the control unit ss 
waits for establishment of prescribed conditions. When 
the prescribed conditions are established, La, when a 
sufficient quantity of bit stream is stored in the rate 



buffer and a vertical synchronizing signal is supplied, 
the control unit asserts the picture synchronizing signal 
PSYNC in its interior, while asserting the MB synchro- 
nizing signal MBSYNC in synchronization with this pic- 
ture synchronizing signal PSYNC. In a first processing 
section, decoding of block data of the segrtent whose 
header information has been analyzed and analysis of 
header information following this segment are executed. 
Thereafter the MB synchronizing signal MBSYNC is 
asserted every time header information Is analyzed in 
each processing section and prescribed conditions are 
established. 

[0182] Due to the series of initialization or reset 
operations, decoding of block data of the segments can 
be reliably started in response to assertion of the MB 
synchronizing signal MBSYNC to implement high speed 
arithmetic processing also in a reset operation including 
an error return operation. 

[0183] In the aforementioned embodiment, decod- 
ing processing of picture data (pixel data) decoded 
along the MPEG standard is described as an example 
of pixel data decoding processing. However, the present 
Invention is applicable also where processing Is made in 
units of data blocks having certain sizes of variable 
length codes in place of the MPEG standard pixel data, 
if header Information Is provided in a form of variable 
length codes for the block data. Further, the present 
invention is also applicable to data subjected to orthog- 
onal transformation other than DCT processing. 
[0184] Principal features of the present invention 
are as follows: 

(1) Header information is analyzed following 
processing of a data block in one processing sec- 
tion, and data processing starting is done after all 
analysis of the header information is completed. 
One processing section is started in decoding of 
the data block and ended In analysis of the header 
information. When starting of the data processing is 
designated, therefore, each operational processor 
can immediately execute its processing, whereby 
utilization efficiency of the operational processors is 
improved and the data processing can be executed 
at a high speed. Further, the standby time of the 
operational processor is reduced, whereby the time 
period of one processing section can be reduced. 

(2) The time period of the processing section is 
changed in accordance with the result of analysis of 
the header information. The time period of the 
processing section can be changed depending on 
the attributes of the segment to be processed and 
the optimum length of the processing section can 
beset in accordance with the attributes of the seg- 
ment to be processed. It is possible to prevent such 
a malfunction that a next processing section is 
started before completion of one processing sec- 
tion, which may be caused In the case erf a process- 
ing section of a fixed length time, and picture data 



23 



46 



EP1085 465 A2 



46 



can be efficientiy and correctly processed. 

(3) Access to an external memory is executed In 
parallel with decoding of data block data. An influ- 
ence exerted on pixel data decoding processing by 
the access to the external memory can be elimi- s 
nated, and the processing time can be reduced. 
Further, necessary data can be efficiently supplied 

to a data processing part with no destruction of data 
required for pipeline processing in data processing 
part by carrying out the access to the external io 
memory successively in order of writing of restored 
data, writing of an incoming bit stream, reading of 
display picture data, reading of predictive picture 
data and reading of the bit stream. 

(4) When an error occurs in a header information 75 
analyzing process or a variable length decoding 
process, a start code having a prescribed pattern is 
detected and header information of a segment fol- 
lowing the start code is analyzed so that processing 

of a data block subsequent to the analyzed header 20 
information is delayed until preserved conditions 
are satisfied after completion of the analysis. 
Processing can be started at a segment having no 
influence by an error in starting of processing in 
error generation, while the processing is started 25 
from decoding of the data block also In this 
processing starting upon error generation, whereby 
reduction of utilization of each operational proces- 
sor included In data processing part can be sup- 
pressed also after recovery from the error, and data ao 
processing can be executed at a high speed 

(5) A pipeline is formed having one processing unit 
of a processing section correspond to a segment 
Reduction of utilization efficiency of a computing 
element of each pipeline can be suppressed to the as 
minimum and high-speed data processing is ena- 
bled. Further, one processing unit (segment) can 

be shared by a plurality of processing sections In a 
pipeline manner due to pipeline stages, whereby 
the time period for the processing section can be 40 
reduced and high-speed data processing is ena- 
bled. 

(6) The pipeline stages are formed into a four-stage 
pipeline structure in units of segments in accord- 
ance with the content of the processing. It is possi- 45 
We to execute a pipeline operation with the 
minimum wait time of each operational processor 
even if the time period of the processing section 
varies, whereby high-speed data processing can be 
carried out Due to the pipeline structure, further, so 
header information can be analyzed in parallel with 
data processing, whereby the time period for the 
processing section can be reduced and high-speed 
data processing is implemented. 

(7) In error processing, block data of a segment ss 
precedent to that having an error detected are 
repaired in the pipeline stage, with delay of the 
pipeline stage efficientiy utilized, an error repair 



operation can be made on the segment having the 
error caused, and deterioration in quality of a 
decoded picture caused by mixing of an error bit 
can be suppressed 

(8) When a reset request is made, a start code hav- 
ing a prescribed pattern is searched and a process- 
ing start indication signal is asserted when 
prescribed conditions are established after header 
information of a segment following the start code is 
entirely analyzed, to execute processing of the data 
block of this segment Processing can be reliably 
executed from the starting of a picture also in reset- 
ting while each operational processor can be imme- 
diately driven in response to the processing starting 
to cany out data processing, whereby high speed 
processing can be carried out 

(9) Data decoding processing is started in synchro- 
nization with an externally supplied picture synchro- 
nizing signal (vertical synchronizing signal) 
Indicating starting of a picture. Also In resetting, a 
correct pixel data processing operation and reading 
of display picture data can be carried out by estab- 
lishing synchronization with the synchronizing sig- 
nal supplied from an external control unit 

[0185] Although the present invention has been 
described and illustrated in detail, it is dearly under- 
stood that the same is by way of illustration and example 
only and is not to be taken by way of limitation, the spirit 
and scope of the present invention being limited only by 
the terms of the appended claims. 

Claims 

1. A picture decoding circuit for extending a moving 
picture compressed in accordance with a predeter- 
mined procedure in units of segments of prescribed 
sizes for restoring decompressed picture data, said 
compressed moving picture being variable length 
encoded, each said segment having a data block 
including data to be processed and a header having 
information indicating attributes of said data of said 
data block, said picture decoding circuit Including: 

data processing means (4, 1212, 1216, 1218, 
1220) comprising (i) header decoding means 
Including analysis means (3, 6) for detecting a 
header from a supplied bit stream and analyz- 
ing information of said header, said analysis 
means (3, 6), including means (6) generating a 
completion signal CPL) indicating comple- 
tion of analysis of all said header information, 
(ii) variable length decoding means (4, 1212, 
1214, 1216, 1220) for variable length decoding 
pixel data of a data block of said segment in 
accordance with the result of said analysis of 
said analysis means and forming fixed length 
pixel data and restoring said pixel data of said 
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data block to decompressed pixel data; 
detect means (5,6) coupled to said analysis 
means (3, 6) and said variable length decoding 
means (4, 1212, 1214, 1216, 1220) for gener- 
ating an error detection signal indicating an s 
error when said error is detected in processing 
of either said analysis means (3, 6) or said var- 
iable length decoding means (4, 1212, 1214, 
1216, 1220); 

code search means (2, 6) coupled to said 10 
detect means (5, 6) for searching for a start 
code having a predetermined pattern from said 
incoming bit stream in response to said error 
* detection signal; 
activation means (1226, 6) coupled to said is 
code search means (2, 6) for activating said 
analysts means (3, 6) in response to code 
detection by said code search means (2, 6); 
and 

means (1 226, 6) delaying execution of 20 
processing of a data block following a header 
following the start code by said data processing 
means (4, 1212, 1217, 1218, 1220) till estab- 
lishment of a prescribed condition for said 
processing of the data block in response to 2s 
said completion signal CPL) indicating com- 
pletion of analysis of said information of said 
header following the start code from said anal- 
ysis means (3, 6). 

30 

The picture decoding circuit in accordance with 
claim 1, wherein said data processing means (4, 
1212, 1216, 1218, 1220) includes a plurality of 
pipeline stages performing processing in a pipeline 
manner with said segments as processing units, as 
wherein one pipeline stage is responsible for each 
said segment, 

wherein said pipeline stages preferably include: 

a first pipeline stage for carrying out loading of *o 
predictive picture data from a memory device 
(1230), variable length decoding of an orthogo- 
nal transformation coefficient of said data block 
followed by inverse quantization thereof, 
a second pipeline stage for forming a predictive as 
picture from said loaded predictive picture pixel 
data, 

a third pipeline stage for carrying out inverse 
orthogonal transformation processing of the 
inverse quantized pixel data and restoration of so 
said pixel data of said data block from said pre- 
dictive picture pixel data and said inverse 
orthogonal transformation processed pixel 
data, and 

a fourth pipeline stage for writing said restored ss 
pixel data in said memory device and/or means 
(1226, 1216, 1220) responsive to an error 
detection signal for carrying out prescribed 



error repair processing in said pipeline stages 
from a data block of a segment being posi- 
tioned in front of a segment at which said error 
is detected In a processing order in said data 
processing means (4, 1212, 1216, 1214, 1218, 
1220). 

3. A picture decoding circuit for extending a moving 
picture compressed in accordance with a predeter- 
mined procedure in units of segments of prescribed 
sizes for restoring decompressed picture pixel data, 
said compressed moving picture being variable 
length encoded, each said seojnent having a data 
Mock including pixel data following a header indicat- 
ing attributes of said data block, said picture decod- 
ing drcuit including: 

analysis means (3, 6) coupled to receive a bit 
stream for analyzing information included in a 
header of a segment included in the supplied 
bit stream; 

data processing means (4, 1212, 1214, 1216, 
1218, 1220) including variable length decoding 
means (4) for performing variable length 
decoding processing on data of a data block 
following the header in accordance with the 
result of said analysis of said header decoding 
means (3, 6), for restoring said data of said 
data block to original picture data; 
search means (2, 6) for searching for a start 
code having a prescribed pattern in the sup- 
plied bit stream in response to a start signal; 
means (6, 1 1 , 14) generating said start signal 
for starting said search means (2, 6) in 
response to a reset request signal; 
means (6, 11, 14) for activating said header 
decoding means (3, 6) in response to detection 
of said start code by said search means (2, 6); 
and 

means (11, 12, 15, 16) delaying execution of 
processing of a data block following a header 
following said start code by said data process- 
ing means (4, 1212, 1214, 1216, 1218, 1220) 
till establishment of a prescribed condition for 
said processing of the data block, in response 
to a completion signal CPL) indicating com- 
pletion of analysis of said information of said 
header following the start code from said 
header decoding means (3, 6). 

4. The picture decoding circuit in accordance with 
claim 3, wherein said prescribed condition is appli- 
cation of synchronizing signal (PSYNC) indication a 
start point of a picture to be displayed 
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